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I-    INIBODOCTION 

2.       EICKGBOUND 

Khen  a  computar  user,  frcm  his  terminal,  submits  a  job 
to  the  computer,  it  vculd  be  desirable  for  him  that  th€  job 
be  prccessed  right  away.  However,  this  rarely  happens  in  the 
real  world,  because  a  computer  system  usually  consists  of 
only  one  Central  Processing  Unit  (CPU)  and  many  terminals. 
So  if  more  than  one  person  uses  the  computer,  there  will  be 
jobs  that  request  prccessing  at  the  same  time.  Hence,  seme 
kind  of  quFueing  system  or  time-sharing  technique  will  be 
needed  to  organize  the  allocation  of  processing  time  to 
those    submitted    jobs. 

Generally,  a  computer  system  has  two  types  of  processing 
time  allocation.  One  is  called  "Batch  Processing".  All  the 
jobs  submitted  this  way  form  a  kind  of  queue  and  wait  to  be 
served         (processed)  according        to  the        well        known 

First-Ccire-First-Served  (FCFS)  policy,  i.e.  the  first 
submitted  job  is  processed  to  completion,  then  the  computer 
is  set  up  for  the  next  waiting  job;  in  some  systems  a 
priority  policy  based  on  the  length  of  a  job  is  used  to 
determine  the  next  job  to  get  dedicated  use  of  the 
processor.  The  other  one  which'  is  of  interest  for  this 
thesis  is  celled  "Time-Sharing  Processing".  It  is  based  on 
a  technique  that  permits  concurrent  processing  of  two  or 
more  jobs.  Each  job  no  matter  when  it  is  submitted  gets  an 
equal    share   of    processing  time    until   completion. 

E.       FEOCiSSOR-SHARIHG   SYSTEM. 

The  so-called  "Processor-Sharing"  or  "pure  time-sharing" 
in    computer   engineering   is    the   system    in   which   the    processor 


shares  its  service  (procassing  time)  squally  among  all  jobs 
submitt'Bd.  In  other  words^  if  an  individual  job  requiring  a 
certain  amount  of  prccessing  time  is  tagged  and  submi-t«=d  to 
the  system  and  finds  (j-1)  other  jobs  being  processed,  '  then 
from  now  on  all  j  jobs,  will  each  receive  service 
(processing  time)  equal  to  (1/j) -th  of  a  (prccessing)  time 
unit  per  ticne  unit.  Of  course  the  rate  at  which  submitted 
jobs  receive  service  changes  each  time  a  new  arrival  joins 
the    system    and    each    tiire   a    completed    job   departs. 

This  abstraction  cf  computer  capacity  allocation  may  be 
described  in  more  foriral  terms  as  follows  :  if  the  chance 
that  any  single  job,  processed  alone,  finishes  in  time 
interval      (t,t  +  h)         is      u-h      •♦■      o  (h)  ,  (   exponential-Markov 

service  ),  then  the  chance  that  a  particular  "tagged"  jcb  in 
the  ccmpany  of  (j-1)  others  finishes  in  (t,t-«-h)  is 
U(h/j)+o(h)    as    h   approaches    zero. 

Clearly,  there  is  no  waiting  line  in  processor  sharing 
cf      the      abcve      type.  It    permits      short      jobs      access     to 

processing   right   away   even    if   they   arrive   after   longer    jobs. 

Processor  sharing  is  an  approximation  to  the  processor 
sharinc  "Round-Eobin"  model.  In  this  model  once  a  particular 
tagged  jcb  enters  the  system,  it  joins  the  end  of  an  ordered 
queue.  Shen  it  reaches  the  service  point  it  is  allocated  a 
fixed  quantum  (q)  cf  service  time.  If  the  job  completes 
within  this  time  it  simply  leaves  the  system.  If  after  q 
seconds  it  still  requires  more  service,  it  is  immediately 
returned  to  the  end  of  the  queue.  This  process  then  gees  on 
and    en    until  the   required   service   is   completed. 

In  the  limit,  however,  as  g  approaches  zero,  the 
Bound-Robin  system  becomes  the  Processor-Sharing  system.  The 
latter  system  here  will  be  studied  for  its  characteristics 
relatirg  to  the  distribution  cf  response  time,  i.e.  the  time 
that  a  tagged  jcb  requiring  a  certain  amount  of  processing 
time  actually  taken  to  complete  the  service  and  leave  the 
system. 
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C.       MODEL    AND    APPROXIBATE    DISTBIBOTION 

Apfarently  the  first  study  of  dalays  to  arriving  jobs 
under  processor  sharing  was  conducted  by  Coffman,  Muntz,  and 
Irotter  (1970).  [  R€f .  1]  They  assumed  a  steady  state  VK/1 
system  under  processor  sharing,  i.e.  Poisson  arrivals  and 
exponential  service  times  with  a  single  server  processor. 
They  then  derived  an  expression  for  the  Laplace  transform  of 
the  waiting  time  distribution  of  an  arriving  job  conditioned 
en  the  processing  tiire  it  requires  and  the  number  of  jobs  it 
finds   in   the  system    en  arrival. 

The  properties  cf  the  response  time,  R,  given  the 
processing  time  required  by  the  arriving  job  under  processor 
sharing  system  was  further  analyzed  by  D.  Mitra  (1981) 
[Ref,  2]  for  the  following  model.  A  system  consisting  of  N 
terminals  and  a  single  computer  (CPU)  can  be  modeled  as  a 
classical  machine-repair  situation  :  each  thinking  terminal 
(failure-prone  machine)  applies  for  computer  service  at  rate 
^  ,  and  queued  or  waiting  jobs  are  served  at  rate  u  as 
long  as  any  jobs  are  present.  If  Markov  assumptions  are  made 
throughout,  then  X jt) ,  the  number  of  jobs  at  the  service 
stage,    is   a   birth   and   death    process    with   transition   rates    : 


X(t)     =    j >    X(t+h)     =    j   +    1       :        X-h    +   0(h) 


— ->  X(t>h)    =   j  -    1      :       u^h   +    0(h)  (1.1) 

— ->   X(t^-h)     =    j  :      1    -    (  Xj   +    V^^  )  h    +   c(h) 

where  X-  =  X(N-j)  is  the  rate  at  which  a  job  is 
submitted  tc  the  computer  when  there  are  already  j  jobs  in 
the  system,  and  u-  =  U  for  j  >  1,  otherwise  being  zero,   is 


the  rate  at  which  ths  ccmputer  gives  service  to  all  j  jcbs 
submitted.  Based  on  the  above  transition  rates,  the  distri- 
tution  cf  response  time  under  processor  sharing  is 
characterized,  and  the  mcnients  such  as  niean  and  variance  are 
found  under  interesting  conditions,  i.e.  the  conditional 
response  time,  given  only  the  processing  requirement  T  time 
units,  derived  from  the  condition  that  the  tagged  job 
requiring  T  time  units  of  processing  arrives  to  find  (j-1) 
ethers   in   the   system.      [ Ref .    2] 

Gaver,  Jacobs  and  Latouche  [Ref.  3]  have  generalized  and 
extended  the  previous  analysis  by  introducing  the  idea  of 
processor  sharing  in  an  arbitrary  birth  and  death  prccess 
environment,  thus  allowing  quite  general  terminal-computer 
interactions  to  te  represented.  In  the  process,  the  meaning 
cf  "system  state  at  the  moment  of  tagged  job  arrival"  is 
also  clarified  by  Lavenberg  and  Reiser.  [Ref.  U]  Response 
time  characteristics  are  computed  under  the  assumptions  that 
processor-sharing  service  rates        are  processcr-state- 

depsndent  ir.  a  mere  general  way  than  that  described  earlier; 
this  allows  for  approximate  representation  of  overhead 
penalties  and  also  of  job  scheduling.  Other  characteristics 
of  tagged  job  response  are  also  studied,  e.g.  the  accumu- 
lated processing  work,  W  (t • ) r  actually  performed  on  that  job 
by  elapsed  time  t*,  with  t'  <  T  (T  =  required  processing 
time)  following  job  introduction;  note  that  W(R)  =  T,  so 
the  first  passage  of  W(t«)  to  T  is  actually  the  response 
time.  Although  differential  equations  may  be  obtained  for 
transforms  cf  W(t«)  under  various  initial  conditions,  and 
hence,  implicitly  for  its  distribution,  the  results  are  far 
from  being  explicit  and  informative.  However,  central  limit 
theorems  for  additive  functionals  of  Markov  processes,  or 
for  cumulative  processes,  allow  the  conclusion  that  the 
accumulated  work  accomplished  by  fixed  time  t»  on  a  "long" 
job  is        also  approximately        normally  distributed. 
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Additionally,  a  noriral  approximation  is  shown  to  ta  valid 
for  th3  simple  mod^l  — and  probably  for  others  as  w€ll-- 
when  the  number  cf  ccmpeting  terminals  becomes  large  ,  i.e. 
under  heavj  traffic  conditions.  The  quality  of  the  ncrmal 
apprcximaticns  for  finite  job  lengths  and  for  a  finite 
rumber  of  terminals  will  be  assessed  by  simulation  me+hods 
in    chapter    IV  of  this  thesis. 

The  differential  equations  for  the  mean  and  moments  of 
the  response  time  of  a  tagged  job  requiring  a  fixed  amount 
cf  processing  time,  given  that  it  enters  to  find  an  initial 
number  cf  ether  jobs  being  processed,  will  be  derived  in 
chapter  II.  To  remove  the  condition  of  initial  system  state, 
we  will  use  the  steady-state  distribution  of  the  number  of 
jobs  at  the  service  stage.  This  will  also  be  explained  in 
the  same  chapter.  A  procedure  to  simulate  the  response  time, 
given  again  an  initial  system  state,  will  be  described  in 
chap-*-€r  III.  The  empirical  response  times  obtained  from 
simulation  will  then  be  considered  as  stratified  random 
samples.  Fence,  a  method  of  computing  the  central  moments 
will    be   given  accordingly. 

In  chapter  V,  we  will  study  a  bivariate  birth  and  death 
process  model  for  a  computer  system  having  two  types  of 
terminals.  This  model  allows  relaxation  of  the  independent 
identically  distributed  exponential  service  requirement  and 
terminal  think  times  of  the  model  described  by  Mitra. 
[Hef.  2]  Under  the  same  conditions  as  the  previous  simple 
model  with  one  job  type,  we  will  derive  normal  approxima- 
tions for  the  distribution  cf  the  response  rime  of  a  tagged 
job  requiring  t  units  cf  processing  time.  As  before,  simu- 
laticE  methods  will  be  used  to  assess  the  accuracy  of  normal 
approximation  to  the    distribution   of   the    response    time. 
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II.    HiAN    AND    HCBEHTS    FOB    J    SINGLE    JOB    TYPE    jlODEL 

1.       INTBCDOCTION 

In  this  chapter,  we  consider  tha  birth-death  process 
modal  with  rates  in  (1.1)  •  Even  though  the  unconditional 
mean  and  variance  of  response  time  of  a  Processor-Sharing 
system  niay  te  obtained  by  deriving  the  Laplace  transform  of 
the  equilibrium  waiting  time  distribution  [Ref.  1  ]  it  is 
also  interesting  to  develop  seme  results  for  the  conditional 
expectation  of  response  time  of  a  job  requiring  T  units  of 
processing  time,  since  in  the  real  world  one  might  rather 
wonder  how  long  a  job  that  requires  certain  amounts  of 
processing  time  will  te  delayed  after  being  submitted  to  the 
system. 

We  will  show  that  the  equilibrium  mean  waiting  time  in 
the  Processor-Sharing  system  varies  linearly  with  the 
service   time  requirement  T,      i.e.      E(X)    =    XT/(  U  (1-  X/M  ))  » 

as      T >  oo .         Thus     for    arrivals      having      a   service     time 

requirement  less  than  the  average,  i.e.  T  <  1/ p  ,  the  mean 
response  time  is  less  in  the  Processor-Sharing  system  than 
in   the   First-Come-First-Served  system. 

Ic  derive  the  ccnditior.al  mean  response  time,  a  given 
tagged  job,  i.e.  a  particular  job  that  enters  to  find  (j-1) 
ethers  waiting  for  service  time,  and  that  requires  "T"  units 
of  processing  time  will  be  considered.  Then  under  Markov 
assumpticns  a  system  of  differential  equations  will  be 
established  to  allow  computation  of  the  conditional  mean 
response  time  by  numerical  methods.  Other  moments  may  also 
te  obtained  by  means  of  solving  other  systems  of 
differential  equations. 
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E-       CCNDITICN    ON    REQOIRED   TIME    AND    SYSTEM    STATE. 

Undar  tha  assurapticns  of  a  Markov  process,  i.e.  hirth 
and  death  process,  on  the  number  of  jobs  at  th-^  servic?' 
stage  of  a  system  of  "N"  terminals  and  a  single  ccmputar 
(CPU)  with  transition  rates  as  in  equation  (1.1)  ,  a  system 
cf  differential  equations  for  the  mean  response  time  may  be 
derived   as    follows. 

Let  E  refer  to  the  response  time  of  a  newly  arrived 
job,    and 


m.(T)     =    ECR|X(0)     =    j,    W(B)     =    T]    ,  (2.1) 


the  ccnditicnal  expectation  of  the  response  time,  given  that 
the  tagged  job  is  initially  in  the  company  of  (j-1)  others, 
i.e.  arrives  to  find  (j-1)  jobs  present,  and  requires 
"work"   cr    processing    time   equal   to      T. 

Let      Xj     and     Uj      be     as      in    (1.1).  Consider    all      the 

possible  system  changes  in  (0,h),  and  subsequently;  any  of 
the    fcllcwing   mutually  exclusively   events    may   occur: 

(a)  new  job  arrival,  bringing  the  state  to  j+lr  an 
event   cf   probability     \h, 

(t)  accompanying  job  departure  and  return  to  think  mode, 
an   event   of   probability    ( j- 1)  U  (r(j)/j)h, 

(c)  no  change  in  accompanying  system  state  but  a  reduc- 
tion in  remaining  tagged- jot  service  of  (r  ( j) /j)  h  ,  an  event 
cf    prcbatility    1-(  Xj  +  ( j-1)  (*   (r(j)/j))h. 

All  ether  possible  events  are  of  probability  o  (h)  and 
may    te    ignored. 

Ihe  term  r(j)  used  above  represents  the  fraction  of  time 
the  processor  actually  spends  processing  when  there  are  j 
jobs  being  processed.  The  fact  that  r(j)  <  1  represents 
overhead. 

\ 
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letting       p»j    =     (j-1)^  (r(j)/j),    (a),     (b)    and    (c)     lead   tc    : 
mj  (T)     =    h+in^(T-(r  (j)/j)h    )[1-(X^  ■«■  pj)  h]  (2.2) 

*  ^4hm^^j(T-(r  (j)/j)h)  +  pjhinj.,(T-(r(j)/j)  h)+o(h)  . 

Subtract    m  •  (T-  (r  (j)  /  j)  h)       from   each    side    ,      then    divide    by  h 

and    let    h   >    0    to    get   the    differential   equations    : 

(r  (j)/j)m^MT)    =     1-     (  Xj  *   f*j   )     m^(T)  (2.3) 
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^X.ir-^,(T)    *  f^j^i.^JT). 

This  is  a  standard  system  of  linear  differential  equa- 
tions ,  initial  conditions  are  m- (0)  =  0  for  all  j  .  A 
solution  can  be  obtained  in  terms  of  Laplace  transforms,  by 
exponential  formulas  involving  matrices,  or,  numerically,  by 
use  of  standard  computer  codes  for  the  solution  of  systems 
cf  linear  differential  equations.  Simple  explicit  and 
comprehensible    closed   form    results   do   not   seem  attainable. 

C.       CCNDITICN   OH    REQOIBED  TIME 

The  condition  that  the  tagged  job  entered  to  find  (j-1) 
ethers  in  the  system,  i.e.  X  (0)  =  j,  can  be  removed 
according  to  the  stationary  distribution  that  corresponds  to 
the  system  state  found  by  the  arriving  job.  The  resulting 
expression  allows  the  conclusion  that  the  expected  response 
time  is  "linear"  in  the  required  processing  time,  T.  The 
result  here  holds  for  quite  general  birth-and-death  process 
model,  not  only  for  the  simple  machine-repair  setup  detailed 
here.      [Eef.   5] 
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Th€  derivation  cf  linearity  of  the  expected  response 
time    is   developed,    in  outline,    as   follows. 

First,  observe  that  the  long-run  distribution  cf  X(0), 
i.e.  the  number  of  jobs  present  (including  the  tagged  job) 
just    af-^.er    •*--he   taggec    job   enters    ,    is 

''J    ^    ^"^J-»\-\  "    cTTj|Jl^(J)  '    :5    =    1r2,...,N  (2.4) 


where    c    is    selected    sc   that    the    q    's    sum   to   one,    and    for   all 

j's,  TT^  =  TTo(>.o>^i--"^j-i^/^f^«p2' "Ki^  -^  ^^'^  stationary 
distribution  (assumed  to  exist)  of  the  Markov  chain  X(t), 
i.e.  the  rumber  of  jots  at  the  service  stage,  with  rates  as 
in  (1.1)  with  pj  =  ^r(j).  The  equation  (2.4)  is  intui- 
tively apparent,  for  the  long-run  probability  that  a 
transition   from    j-1    tc   j   occurs      in    (t,t  +  h)       is       TT;  ,X'  .^   ^s 

h  >   0   and  hence   equation     (2.U)       follows   by  normalization. 

A  foriral  proof  can  be  provided  based  either  upon  an  embedded 
Markov  chain  formulation,  or  upon  the  theory  of  additive 
functionals  of  a  Markov  process.  [Ref.  6]  The  distribution 
^  q_^^      has    also    been    given    by   Kelly.      [Ref.    7] 

Next,      use    equation    (2. U)      to      remove    the   condition  that 
X(0)     =    j.    Put 

M 

m(I)    =E        E[R|X(0)  ,W(R)  =T]    =      S  q.  m  •  (T)  .  (2.5) 

Then  in  terms  of  the  differential  equations  (2.3);  after 
multiplying  through  ty  j/r  (j) ,  one  obtains,  with  initial 
conditions    m-(0)    =0, 

m*  (T)    =    Z(J/r  (j))qj:+Zq:  (J/r  (j)  )[-(X-  +  p;)m:(T) 


*   Xjm -,,(!)    ^f4-m^^^(T)] 
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N 

m»  (1)     =    2{j/r(j))  q;.  (2.6) 

Ihas  it  fellows  that  tha  long-run  conditional  axpecxed 
response  tiie  of  th€  processor-sharing  system  is  linear  in 
the    processing    time    requirement   T: 

ECB|W(F)=I]  =    I2.i1/T:  (D)  q: 

=    TE[X(0)/r(X  (0)  )  ].  (2.7) 

Apparently  no  such  simple  form  exists  for  Var[ R | W  (R) =T  ], 
although  Mitra  [ Ref .  2]  has  given  a  formula  for  a  particular 
case.  It  will  be  shewn,  however,  that  the  above  variance  is 
indeed   proportional    tc   T   if    T    is    large. 

D.       MCBESTS    AND    VARIfiBCE   OF    HESPCNSE    TIME 

The  conditional  noments  for  response  time  of  a  job 
requiring  T  units  of  processing  time  may  be  obtained  by  a 
similar  derivation  tc  that  used  for  the  expected  conditional 
respcEse  time.  For  example,  to  find  an  expression  in  differ- 
ential equation  form  of  the  second  moment,  one  has  to 
consider  all  the  possible  system  changes  during  time  period 
(0,h)  as  has  teen  done  for  the  mean  response  time  in 
previous  section.  If  the  conditional  second  moment  of 
response  time  of  a  tagged  job  that  requires  T  units  of 
processing   time    is: 


m2.(T)     =    E[R2|X(0)=j,W(R)  =T],  (2.8) 


then,  the  following  results  subsequently  occur: 
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in2     (T)-m2.  (T-  (r(j)  /j)  h)  (2.9) 

=    2m;  (T-(r(j)./j)h)  -(Xj  +  f^i)  in2^.  (T- (r  ( j)  / j )  h) 

+  X^m2j^,(T-(r(j)  /j)h)     +  Jij^^^.,  (T-(r(j)/j)h). 

As   h   >   0    one    attains    the    diffsrantial   equations: 

(r(j)/j)[dm2^  (T)/dT]   =    2m^  (T)-(  X^+  (1^)012^  (T) 

*  Xjni2^^  (T)+  {i.in2^^^(T).  (2.10) 

Again,  the  distribution  found  in  (2.U)  can  be  used  to 
remove  the  condition  that  the  job  enters  to  find  j-1  ethers 
in   the   system. 

The    variance   may   then   be   computed    by    usual   formula,    i.e. 

Var[R(T)]   =    E[  B2  (T)  ]    -    [E[R(T)  ]]2. 

Likewise,  the  differential  equations  for  the  third  and 
fourth  mcments,  m'.  (I)  and  m*.(T),  may  be  obtained  by  the 
procedure  used  to  evaluate  the  first  and  second  moments.  The 
expressions  for  these  moments  are  as  follow: 

(r(j)/j)[dm3  (T)/dT]  =  3m2.  (T)  -  (  X.+ fl^)  m3.(T) 


(r  (j)/j)[dmMT)/dT]  =  am3.  (T)  -  (X: +KA;  )  m*,  (T) 


+  X;iP*^  (T)  +  u.m^  (T)  .       (2.12) 
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Cr.c<=  the  condition  of  initial  system  stat9  is  reiroved 
using  the  expression  cf  (2. 4)  we  can  compute  the  third  and 
fourth  central  moments  by  expanding  the  powers  in  order  to 
calculate  them  in  terms  of  moments  around  the  origin 
obtained  from  solving  the  system  of  differential  equations 
described  ahove.  The  central  moments  may  be  expressed  in  the 
follciiing   forms: 

Er   (B  (I)-E[R(T)  ])  3  ]    =    ECR3  (T)  ]-3E[  R2  (T)   ]E[R(T)  ] 

+  2C2[R(T)   ]]3 
E[  (F(T)-ECR(T)   ])  ♦  ]    =    E[R*  (T)   ]-4EC  R3  (T)  ]E[R(T)  ] 

^•6E[B2  (T)   ][  E[R  (T)  ]]2-3C  E[R  (T)   ]]♦. 

The   skewness  and  kurtcsis   of   response    time    are   then   computed 
as   fcllovs: 

Skewness   =  S[  (F(T)  -E[  R  (T)   ])  3  ]/(Var[  R(T)  ])  ^ , 

Kurtosis    =   ^E[  (R  (T  ) -EC  R  (T  )  ])  ♦  ]/((Var[R  (T)  ])  ^)\  -3. 

I.       NBMEBICAL   RESULTS 

The  conditional  expected  response  time  mj(T)  and  the 
conditional  moments  ffi2.  (t)  ,  m3.(T)  and  m*,(T)  can  be  computed 
by  solving  the  differential  equations  (2  .  10) - (2. 12)  using 
numerical  methods,  i.e.  either  linear  or  Runge-Kutta 
irethcds.  Once  these  results  are  obtained,  the  condition 
that  the  tagged  job  enters  to  find  j-1  others  in  system  is 
removed.  Hence  we  will  obtain  the  mean  and  the  second, 
third  and  fourth  moments  of  response  time  of  a  job  that 
requires  T  units  of  processing  time.  These  values  can  then 
te  used  to  compute  the  central  moments,  and  eventually  allow 
us  to  determine  the  variance,  skewness  and  kurtosis  for  the 
distribution  of    response  time. 
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Table  I  shows  the  means,  variances,  skewnessas  and 
kurtcsises  cf  response  time  cf  a  job  requiring  T  units  of 
processing  time  for  a  system  cf  2  terminals  with  arrival 
rate  X  =  1  and  service  rate  ji  =  2 .  We  see  that  as  the 
required  work  time  becomes  large  the  distribution  of  the 
response  time  is  moderately  close  to  a  symmetric  one,  since 
the  skewnesses  are  small.  The  kurtosis  is  also  approaching 
zero  as  the  required  «ork  time  becomes  large.  This  suggests 
that  the  distribution  of  the  response  time  may  be 
approximated  by  a  normal  distribution  for  large  required 
work    time. 


TABLE 

I 

Numerical 

Results 

for   2   Terminals 

1 

X  =   1, 

V 

=    2 

Iii§ 

Mean 

Var  iance 

Skewness 

Kurtosis 

C.10C0 

0.1335 

0.0020 

0.6633 

-1.3415 

0.2000 

0.  266  8 

0.0  074 

0.7078 

-1.3042 

C.30G0 

0.4002 

0.0  152 

0.7053 

-1.2428 

0.5000 

0.6668 

0.0358' 

0.6876 

-1.0823 

1.0000 

1.3325 

0.1031 

0.5729 

-0.6024 

2.0000 

2.67  19 

0.2656 

0.5118 

-0.4626 

3.0000 

4.00  8  4 

0.4569 

0.4614 

-0.3802 

5.0000 

6.6815 

0.7711 

0.2554 

-0.1976 
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III.     SI  MO  I AT I ON    FOR    ONE    JOB    TYPE    MODEL 

«.       INTRCDDCTION 

The  rumerical  method  of  computing  the  moments  of  th® 
conditional  response  time  of  a  tagged  job  that  requiras  seme 
fixed  amcunt  of  processing  time  indicated  in  the  previous 
chapter  is  generally  sufficiently  accurate,  especially  if 
carried  cut  by  the  Runge-Kutta  method.  However,  the  distri- 
bution of  the  response  time  is  also  of  interest.  We  will  use 
simulation    to   study   this  distribution.  We   will    describe   a 

simulation  routine  fcr  response  time  of  a  job  requiring  a 
fixed  amcunt  of  processing  time  for  the  model  with  one  job 
type    described    in   chapters    I   and   II. 

Ihe  conditional  response  time  of  a  tagged  jcb  that 
enters  tc  find  j- 1  ethers  initially  present  in  the  system, 
and  requires  T  units  of  processing  tima  can  be  simulated  for 
the  model  if  the  jet  submission  rate  to  the  processor  of 
each  teririnal  and  the  processing  rate  of  the  processor,  i.e. 
^  and  u ,  are  known.  Under  Markov  assumptions, the  number  of 
jobs,  including  the  tagged  one,  in  the  Processor-Sharing 
system  which  consists  of  one  processor  and  N  terminals  is 
considered  as  a  birth  and  death  process  with  transition 
rates  Aj  =  X(N-j)and  jAj  =  JJl  (j-1)  r  ( j)  /  j,  where  r  ( j)  is 
defined  as  £  fraction  of  time  the  processor  actually  spends 
processing  when  there  are  j  jobs  being  processed  including 
the  tagged  job.  Thus  the  interarrival  time  and  the  departure 
time  (work  completed)  of  the  jobs  in  the  system  are  exponen- 
tially distributed  with  parameters  X-  and  u^  respectively. 
We  use  the  LLRANDCKII  package  available  for  the  Naval 
Postgraduate  School  computer  system  to  generate  the  two 
exponential  times  with   rates    X;  2-iid    u*   respectively. 
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The  generated  arrival  and  departure  times  are  ccmpared 
and  the  sojcurn  time  in  state  j  is  determined  as  well  as  the 
next  state  cf  the  system  and  the  amount  of  processing  tima 
the  tagged  job  gets  from  the  processor  during  the  sojourn 
time.  We  -hen  repeat  the  procedure  until  th^  accumulated 
processing  time  for  the  tagged  job  meets  the  requirement  of 
work    required  to   completion, 

B.       ICRK    TIHE 

It  turns  out  to  te  especially  convenient  to  measure  time 
in  terms  of  the  amount  of  actual  work  or  processing  that  has 
heen  accomplished  on  the  tagged  job.  Let  C  (w)  denote  the 
number  of  jcbs  undergoing  service  at  a  moment  when  exactly  w 
units  of  processing  have  been  accomplished  on  the  tagged 
job.  We  will  also  assume  r(j)  =1  for  all  j.  The  rate  of 
accretion  cf  clock  or  response  time  at  work  time  w  is  C(w): 
if  C  (w)  -  1  then  the  tagged  job  is  alone  and  response 
(clock)  time  and  work  time  advance  at  the  same  rate,  while 
if  C  (w)  =  17  the  tagged  job  is  accompanied  by  16  others  and 
17  units  cf  response  time  accrue  for  every  single  work  time 
unit.  It  fellows  that  the  response  time  for  the  tagged  job 
requiring   T   units   of    processing   time    is    simply 

R(T)     =     jc(w)dw. 
o 

The  process  {c(w)"}  is  a  birth  and  death   process  related  to 

w 
X(w)  .   It  has  arrival  and  departure  rates  X\  -    Aj(N-j)  and 

w 

U;     =     Uj.    All    the    sittulaticns   described   in   this    thesis   will 

be   dene    in    «ork    time. 

To  obtain  the  conditional  expected  response  time  of  a 
tagged  job  that  requires  T  units  of  work  time  as  in  previous 
chapter,  we  remove  the  condition  that  the  tagged  job  entered 
to  find  j-1  others  initially  present  in  the  system  by 
applying  the  same  steady-state  distribution  cf  the  number  of 
jcbs    in   system,    q    ,    found  in    (2.4). 
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C-       S3M0IATI0N    FOR    A    2-TERMINAI    SYSTEM 
1  .       Alqcrithm 

lie  will  first  describe  -the  simulation  by  considering 
a  siirple  computer  system  which  consists  of  on=5  processor  and 
cnly  two  terminals.  Each  terminal  submits  jobs  to  be 
processed  by  the  processor  at  rate  X  and  the  processor  has 
a  service  rate  of  u-  for  jobs  already  present  in  the  system. 
The  service  effort  is  allocated  equally  to  all  jobs  present 
in  the  system  at  any  time.  Therefore,  if  a  job  requiring  T 
units  of  wcrk  time  enters  tc  find  the  system  empty,  th^ 
arrival  rate  of  the  ether  job  will  be  X  while  there  will  be 
no  departure.  Similarly,  if  the  job  enters  to  find  the  other 
one  already  present  in  the  system,  there  will  be  no  arrival 
while    the    service   rate   will    be    Ur(2)/2. 

To  transform  the  rates  into  the  terms  of  work  time 
we  multiply  them  by  1/r(1)  and  2/r(2)  respectively.  Thus, 
the  arrival  rate,  if  any,  becomes  X/r(1)  and  the  service 
rate,    if   any,   is   simply    jji . 

Eased  on  the  above  transition  rates  an  algorithm  to 
perfcim  sinulation  for  the  conditional  .  response  time  and 
eventually  the  mean  response  time  of  a  job  requiring  T  units 
cf    piccassing   time    will    be    given   as    follows. 

Algorithm  tc  simulate  response  time  of  a  job 
H3,]iili^S  I  liSill  2f    processing   time   in    a    2-terminal   system. 

let  w^  =  amount  of  work  time  remains  to  accomplish 
for   the   tagced    job. 

Cq  =   amount     of    clock      time    accumulated      towards 
the   response  time   of   the  tagged    job. 

Step   2    *      Set   Wjj   =    T   and   c^  =    0 

Step  2  :  If  the  tagced  job  enters  to  find  the  system  empty, 
otherwise  gc  to  step  3,  generate  an  exponential  time  with 
parameter    X/r(1).    Call  this   t'. 
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a)  If  t*    ^Wq'   ^^"^  ''- ^®   ccr.ditional   response    time 

STOP 

b)  If   t'    <    Mq,   set     : 

w©    =   Wo-t»,    Cp   =   Cj,  +  tVr{1)  . 

GO    TO    St€F3. 

Step  3  :  If  the  job  enters  to  find  another  one  already 
present  in  the  system,  i.e.  j  =  2,  generate  an  exponential 
with    parameter    u .    Call   this   t". 

a)  If  t"   ^    w^ ,    set    the   response    time 

P^=    c^  +  2Wo/r  (2)  . 
STOP 

b)  If   t"   <    Wq,   set    : 

^o    =   ^0-"^"'    ^o   ^   S  +  2t"/r(2). 

GO    TO   Step    2. 

Bepeat  the  above  procedure  until  we  obtain  the 
conditional  response   times    for   both   cases. 

To  find  the  mean  response  time  we  use  the  long-run 
distribution  of  the  rumber  of  jobs  in  system  just  after  the 
tagged    job   entered,    i.e. 

qj    =  cTTj.^Xj-^   =    c-n^^r(j)  , 

where  j  =1,2  and  ^,+^2  =  1  and  TT*  is  the  stationary 
distribution  of  the  continuous  time  Markov  chain,  ^XCt)"^. 

The  mean  response  time  of  a  job  requiring  t  units  of 
work  time  is  then 

I[R]  =  B,g,  +  R^q^^, 

where  R,  rP'i  are  the  conditional  mean  response  times,  given 
the  tagged  job  enters  to  find  the  system  empty  and  one  job 
already    present    respectively,    generated   by    the  algorithm. 

The  variance,  skewness  and  kurtosis  of  the  response 
time      may  also      be    obtained      by   deriving      the   usual      central 
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ffomer.ts.      These      calculations    will    be      detailed    ir.      the   n€Xt 
sect  icr. 

2 .      Numerical   Results 

The   numerical  results   shown    in   Table    II    ara   obtained 
from    the  outputs  of    a     computer      program      written    in    FOHTEAN 


f "•" 

J 

TABLE 

II 

Simalatici 

I   results 

f( 

Dr   2   terminals                            | 

X  =  1, 

I* 

=    2 

Time 

Mean 

Std  .Dev 

i 

Skewness 

Kurtosis 

0.1000 

0.1339 
(.0006) 

0.0452 

0.6839 

-1.4462 

C.2000 

0.26a8 
(.0014) 

0.0851 

0.7550 

-1.2457 

C.3000 

0.40  31 
(.0027) 

0.1229 

0.6459 

-1.3044 

C.5000 

0.66  8  8 
(.0047) 

0.1 913 

0.6477 

-1.1835 

1  .0000 

1.36  69 
(.0098) 

0.3200 

0.6017 

-1.0297 

2.00C0 

2.6864 
(.0157) 

0.5051 

0.5690 

-0.4870 

3.0000 

4.0128 
(.0211) 

0.6516 

0.5184 

-0.2896 

5.00C0 

6.68  6  3 
(.0269) 

0.8224 

0.2974 

-0.1623 

_    
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using  the  above  algorithm  to  simulat9  the  conditional 
respciis3  time,  given  the  initial  system  state  when  the 
tagged  jcb  arrives.  The  steady  state  distribution  is  then 
used  to  evaluate  the  unconditional  moments,  and  measures  of 
skewness  and  kurtosis  for  various  work  time  requirements  of 
the  jcb.  The  values  between  parentheses  below  the  means  are 
their  corresponding  standard  errors  which  depend  on  the 
cumber  of  simulation  replications.  These  outputs  are  evalu- 
ated based  on  500  replications  of  the  response  time  for  each 
initial   condition.    The   r(j)  's   are   all   assumed  to    be    uni-^y. 

Note  that  the  moments  obtained  from  the  simulation 
agree  well  with  those  obtained  by  solving  directly  the 
system  cf  differential  equations  for  the  moments  of  the 
response  times.  This  fact  provides  a  check  for  the  simula- 
tion. The  simulated  response  times  show  diminishing  values 
of  skewness  and  kurtosis  as  the  required  work  time  becomes 
large,  again  suggesting  that  there  may  be  an  increasingly 
accurate  normal  approximation  to  the  response  time 
distribution. 

D.       SIHOIATION    FOR    AH    H-TERHIHAL    SYSTEM 
1  .      Algcrith  m 

Now,  consider  a  more  general  computer  system  with 
one  processor  and  N  terminals.  As  before,  each  terminal  has 
a  subicissicn  rate  X  to  the  processor  and  the  processor 
processes  each  job  to  completion  with  rate  u .  The  alloca- 
tion cf  processing  time  always  follows  the  method  of 
"Processor-Sharing" . 

Ihe  simulaticn  for  response  time  of  a  job  requiring 
T  units  cf  processing  time  will  be  done  under  the  condition 
that  when  the  job  arrives  there  are  j  terminals  active,  i.e. 
j  jobs,  including  the  tagged  one  that  just  arrived,  are 
being    served  by   the   CFO.      Here,    j   can   be    1,2,...,N. 
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Under  Processor-Sharing  scheduling,  if  j  jobs  ar^ 
prasert  then  in  a  short  time  interval  of  length  h  the  tagcsd 
job  gets  hr(j)/j  units  of  work  done.  Thus,  if  W(t)  is  th9 
amount  of  work  done  en  tagged  job  by  the  time  iz  has  be^n  in 
the  system  for  t  units  of  clock  time,  and  if  th9  numb«=r  of 
jobs    in    system    during  this    time   t   is    j,    then    W(t)    =    tr<j)/j. 

As  long  as  W  (t)  is  less  than  the  required  amount  of 
work  T  for  the  taggec  job,  we  will  have  to  accumulate  the 
amount  of  «crk  done  computed  according  to  the  number  of  jobs 
in   system   at  that   time.        The   conditional   response    time    will 

te    the    clock  time   t    for    which    the   accumulated   completed   wcrk 

re- 
time    Jw(t')dt«     is    egual  to    T. 

o 

Again   it   is      convenient   to   measure    time      in   terms   of 

work    time.      The    work    time      process,      C(w),      described   in   the 

previous      section      is     a        birth-death      process      with      rates 

X(N-j)  j   =  Xj    and    P4  "    V^  (j~1)  »    1    <    j    <    N.    The   response    time 

is    siroplv   E  (T)     =ic(w)dw,    if   r  (j)    =    1. 

o 

lo  simulate  the  work  time  process,  we  generate  two 
exponential  times  with  parameters  Xj  and  U:  respectively. 
The  minimum  of  the  t«o  will  indicate  which  event,  arrival  or 
departure,  cccurs  first.  If  an  arrival  occurs  first  and  the 
accumulated  completed  work  time  is  still  less  than  the 
requirement,  T,  the  number  of  jobs  being  processed  by  the 
CPU,  i.e.  system  state,  will  be  j+1.  Likewise,  when  a 
departure  cccurs  first  the  number  of  jobs  for  next 
computation   will   be    j-1- 

Th€  above  observations  allow  us  to  construct  an 
algorithi  tc  perform  a  simulation  for  conditional  response 
time  and  lead  eventually  to  the  estimation  of  statistics  for 
the  response  time  of  a  job  requiring  T  units  of  processing 
time    as    follows. 

Algorithm  to  simulate  res£onse  time  of  a  job 
requiring  T  units  cf  processing  time  for  an  N-terminal 
sistem,  given  when  the  tagged  job  begins  processing  there 
are    (j;l)    jobs    also    beins  processed. 
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Let  w^  =  amount  of   work  that  remains   to  accomplish 
for  the  tagged  job. 

Cq   =  amount   of  clock   time  accumulared   towards 
the  response  time  of  the  tagged  job. 

Step  J  :   Set  w^  =  T  and  Cq   =  0. 

Step  2  :  If  j=1,  i.e.  the  job  enters  to  find  th€  system 
empty,  otherwise  GO  TC  step  3,  generate  an  exponential  time 
with    parameter  X,-    Call   this   t«. 

a)  If  t»    >    Wq,   set    the   response    time 

5,    =   Co    +  wo/r  (1) 
STOP 

b)  If   t»    <    Vq,   set 

Wo    =    w^    -   t' 

c©  =  Co  +  t'/r  ( 1) 

J   =    2 

GO    TO   step    3. 

Ste£  3  ;  If  j  =  2r3,...,N-1,  generate  two  exponential  times 
with    parameters    Xj  and   ja*.    Call   them   t'    and   t"  respectively. 

a)  If  min(t'  ,t")    >    w^,    set   the    response    time 

^i    =   ^o    *   «o^/r  (j) 
STOP. 

b)  If   min(t»  ,t")    <    w^ : 

i)    If  min  (t«  ,t"  )    =   t» ,    set 

Wo   =    «o  -  ^-' 

Co  =    Co  -^  t»  j/r  (j) 

j    =      j     4     1 

GO  TO    Step   2    or    3    or    U    according   to    j. 
ii)     If    min(t«,t")    -  t",    set 

w©  "    «o  -  ^" 

Co  =    Co  +  t"j/r(j) 

j  =    j   -    1 

GO  TO   Step   2    or   3   or   U    according   to    j. 
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step  if  :  If  j  =  N,  i.e.  all  terminals  become  active, 
generate  an  expcnential  time  with  parameter  u  .  Call  this 
t". 

a)  If   t"    >    w^,    set    the   response    time 

STOP 

b)  If   t"    <    Vq,   set 

w      =    w       -   t" 

c©   =   <^0    *   t"N/r  (N) 

j    =     N    -1 
GO    TO    Step    3. 
Each  run   of    the   algorithm      for   fixed    initial    j    gives 
a  realizaticn   of  the    conditional   response    time  of    the    tagged 
job    given    there    are     (j-1)       other    jobs    in    the   system    when   the 
tagged    jet   arrives    for   processing. 

2.      Moments   of    Response    Time 

The  simulation  based  on  the  above  algorithm  provides 
a  batch  cf  conditional  response  times  of  a  tagged  jet  for 
each    initial  system    state. 

Suppose  we  simulate  a  batch  of  size  K  for  each 
conditional  response  time  at  initial  system  state  j,  for  all 
j's. 

Let  Rj^  be  the  k-th  realized  conditional  response 
time  given  the  initial  condition  is  j  ;  (that  is,  the  tagged 
job  arrives  when  {j-1)  other  jobs  are  being  processed),  for 
j  =    1,2, ...,N  and   k    =   1,2,.  ..,K. 

Mathematically,  we  can  use  the  averages  of  (RjV)  » 
i  =  1,2,3,U,  over  each  batch  to  compute  empirical  first, 
second,  third  and  fourth  conditional  moments  given  initial 
condition  j  respectively.  Tc  compute  the  unconditional 
empirical  moments  for  response  time  of  a  tagged  jot  that 
requires  T  units  of  processing  time,  we  can  multiply  the 
j-th      conditional     empirical      moment        by      the     steady-state 
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probability        q;      given        by       (2.4)  and        sum  over        all 

j   =    1,2,...,N,       The      empirical    mean,  variance,  third      and 

fourth        central      moments        then      are  computed  by        power 
expansicns,   i.e. 

N 

R 


E[E(T)  ]  =    2R;q:    = 


VarCR(l)l  =    ^R?q.-(R)2  (3.1) 

A.  i  -  ,  ^  - 

E[   (B(T)-R)3]    =    2  R3q.  -3^  ^B?q.  +2(R)  3 

A  '^   -  ^  N>  - 

E[   (R(T)-R)*]    =    :2R.*q.  -URZE?qj+6(R)  22Rfq;  -3(R)  -^^ 

where    r'.    =     (2R;i.)/K,   for   i    =    1,2,3,4. 

Eowsver,  in  practice  the  above  procedure  can  be 
numerically  unstable  since  the  averages  of  the  second,  third 
and  fourth  moments  over  the  batch  may  be  very  large  numbers. 
Hence,  when  we  add  or  subtract  these  numbers  to  compute  the 
central  moments,  it  is  possible  that  the  computation 
produces  round-off  errors  which  may  be  substantial. 
Therefore,  we  would  rather  rewrite  the  central  moments  in 
terms    cf   conditional   expectations,    i.e. 

EC  (R-E(R))*-  ]    =    ECEC  (B-ECR)*-  |X(0)  ]],    i=1,  2,3,4.  (3.2) 


where  X(0)  is  the  number  of  jobs  requesting  processing  by 
the  CFU,  including  the  tagged  job,  when  the  tagged  job 
arrives.  This  allocs  us  to  obtain  the  central  moments  in  a 
more  numerically  stable  manner.  Further  details  will  be 
shown  for  the  computations  of  variance,  skewness  and 
kurtosis   of  the    respcnse  time. 
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3 .   Computation  ct   Simulatsd  Variance 

let   1'      -    (ZR-,l)/K  and   r"  =  2  R •  q  • ,    than   the 
estimatsd  variance 

F  ^' ''-' 

K  ^*"*'' 

K  _ 

Since    (^R^L-Rj  )  /K    =    0,    the    estimated    variance  becoires 

K       '"^ 

Ihis    is    the   sampling    version   of   the    formula 

VarCR]  =    E[Var  (RIX  (0)  )  ]+Var[E  (RIX  (0))  ], 

which  is  a  known  general  result  that  applies  to  any  random 
variable,  R,  that  also  depends  upon  another  random  variable, 
namely  X(0).  The  first  compcnent  represents  the  overall 
variability  of  R  for  a  fixed  value  of  X(0),  and  the  second 
component  represents  the  variability  of  R  due  to  the 
variatility   in    X  (0)  . 

U .      Computation    of   Simulated   Skewness 

To    compute      the   estimated   skewness    we      first  coirpute 

the   third   estimated      central   moment   of   the      response  time   by 

rewriting   it     in  a    conditional      expectation   form    as  we   have 

done  for  the  computation  of  the  variance.  The  third  central 
moment   is   derived  as    shown    below. 

EC  (B^^^-R)3]   =     I^Z^^uk'^^^^i 
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EC  (Hji^-R)  3] 


K.    isi  _ 


K  Ni 

+  3  (E^U^  -"j  )  (Rj  -R)  2+  (Rj  -P.)  3  ]q^.  . 

We   can      ismcva    the      3-rcl   component    on      the    right       hand    side, 
since    (2  R^v-R;  ) /^    =    0.    Thus 


»<    N 


1  =  lX2<^4\c-^i'''ri.l2'^jW-^j''<«i--'^o 


M 


The    measure   of    skewness   of    response   time   is   then 


SkewnessCR^^]    =      S[(Eji^-R)3]      . 

(VarCR^V<])^^ 

5 •      Computation    of   Simulated    Kurt os is 

We      start      bj     rewriting        the      expression      for      the 
estimated   fourth   central   moment   as    follows: 


KM 


-R>  3 


+  6  (R^y^  -Rj)2(R^-R)  2+4(S^y^-R^)    (Rj-R) 


+  (Rj-R)*  ]q^. 
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We  -^hen  simplify,  as  before,  by  removing  the  U-th  term  on 
the    right   hand    side.    Hence, 

therefore,    the    measure  of  kurtosis   is 

KurtosisCR^^]    =      EC  (R^w-H)M      ■ 

(VarCR^^])2 

Since  for  the  normal  distribution  the  kurtosis  has  the  value 
3,  we  then  substract-  3  from  the  kurtosis  computed  above.  So 
the  new  value  of  kurtosis  will  be  0  when  the  distribution  of 
response   time   has  the  normal   degree    of   kurtosis. 

6.      Standard   Error  of  the    Mean   Response   Time 

In  order  to  assess  the  accuracy  of  the  simulated 
average  response  time,  we  may  compute  a  standard  error  for 
the  mean  response  time  of  a  tagged  job  that  requires  T  units 
cf  work  time  from  our  batches  of  simulated  conditional 
response    times. 

We  have  derived  previously  that  the  mean  response 
time    is 

Now,  we  apply  a  property  of  the  variance  function  by  consid- 
ering q  and  K  fixed  constants  and  noting  that  the  R;L'-  are 
obtained  from  independent  realizations.  This  allows  us  to 
write  the  estimated  variance  of  the  expected  response  time 
as    follows    : 

Var 
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To   obtain      the    standard   error    of      the    mean    response      tirre    we 
simply   take  -the    square   root    of   Var[  E[  R_^^  ]  ]. 

7  k      Ni3122i2§.l   Results 

Tables  III,  IV  and  V  show  the  outputs  from  a  simula- 
tion program  based  en  the  previously  described  algorithm. 
The    number      of    replications      for   each      initial  condition     is 


—   . 

TABLE    III 

numerical  rasults   from   simulation                               | 

1 

N    =     10 

r      X    =    15, 

yi   =    100 

Time 

Mean 

Var  iance 

Skewness 

Kurtosis 

C.01C0 

.040368 
(.000177) 

.000295 

.  119865 

-.715162 

0-0250 

.100510 
(.000503) 

.001405 

.088115 

-.712345 

0.0375 

.  151623 
(.000733) 

.002508 

. 015783 

-.587745 

0.C500 

.201580 
(.000952) 

.003865 

-.046461 

-.572722 

0.0625 

.2513U0 
(.001092) 

.004953 

-.012371 

-.510326 

0.1GC0 

.402916 
(.001510) 

.008842 

-.092651 

-.378387 

0.15CO 

.607487 
(.001935) 

.013806 

-.061429 

-.186003 

0-20C0 

.806743 

.01 9704 

-.023100 

-.130595 

(.002303) 

_    ,_ 
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r ■ 

TABLE 

17 

1 
1 

Numerical  ] 

[results   f 

rom   simulation                               I 

1 

N    =    10 

,     X   =    25 

,     \A    =    100 

Tima 

Mean 

Var  iancs 

Skewness 

Kurt osis 

0.0100 

.060567 
(.  000192) 

.000253 

-.773193 

.685650                     1 

0.0250 

.150692 
(.000467) 

.000992 

-.717666 

. 637294 

0-3750 

.226  36  a 
(.000652) 

.001775 

-.697005 

. 532480 

0.05C0 

.302138 
(.000791) 

.002U66 

-.662308 

.533646 

0.0625 

.378130 
(.000925) 

.003266 

-.649630 

.527906 

0.1000 

.  6  03  5  8  4 

.005601 

-.538279 

.509166 

(.001228) 

_ ..    ..       J 

500-  Ihe  numbers  below  the  means  are  their  standard  errors. 
We  can  see  that  the  results  in  the  tables  indicate  a 
somewhat  sjmmetric  distribution  for  the  response  time 
(skewnesses  are  very  small) ,  and  the  kurtosises  do  not 
strongly  indicate  Ecn-nor mality  (they  decrease  towards 
zero)  ,  especially  when  the  processing  time  requirement 
becomes   large.  The   kurtosis   values      in   table    III      seem   to 

indicate  smaller  tails  than  these  in  table  IV,  and  the  sksw- 
ness  values  indicate  that  we  have  a  more  symmetric  distribu- 
tion in  the  case  X  =  15  than  when  X  =  25  for  an  equal 
U  =  100.  In  the  next  chapter  some  normal  approximations  to 
the    response  time  distribution    will    be   described. 
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TABLE    V 
Numerical  results   from   simulation 

N    =   25,     X    =    5,      |Jl    =    100 

Time  ll^M  Var  iance      Skewness      Kurtosis 

0.0100  .063016         .001011  .346171  -.463719 

(.  00  0  2  0  2) 
0.0250  ..158884         .005204         .213798         -.555656 

(.000637) 
0.0375  .239094         .010175         .170748         -.541305 

(.00  100  8) 
0.C50O  .316021         .015985         .159817         -.565249 

(.00  1354) 
0.0625  .394780         .021523         .117365         -.496104 

(.001666) 


N    =    25,      X    =    10,      p    =    100 

liE.2  ^ean  Var  iance      Skewness      Kurtosis 

C.01C0  .149847         .000659         -.527812       .471482 

(.000252) 
C.C250  .375932        .002529         -.644450       .428531 

(.000588) 
0.0375  .562173         .004470         -.667446       .366822 

(.000834) 
C.C5C0  .750556         .006467         -.641420       .314407 

(.001020) 
0.0625  .938072         .008259         -.593361       .275313 

(.001165) 
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17.  NORMAL  ilPBOXIBATION  FOR  RESPONSE  TIMS 

A.   INTRCEDCTION 

The  Markov  assumptions  we  make  on  the  processor-shsring 
system  allow  us  to  infer  that  the  distribution  of  the 
response  time  of  a  tagged  job  that  requires  T  units  of 
processing  time  may  be  approximated  by  the  normal  distribu- 
tion when  T  is  large  and/or  when  the  system  is  in  heavy 
traffic. 

Twc  methods  are  used  to  argue  the  approximate  normality 
of  the  distribution  cf  response  time.  One  is  based  en  the 
Central  limit  Theorem  for  additive  functionals  of  a  birth 
and  death  process,  and  the  ether  follows  from  a  heavy- 
traffic  diffusion  approximation  of  the  birth  and  death 
process.  The  formulas  to  compute  the  approximate  mean  and 
variance    will      be   described.  More   details      concerning   the 

analytic  form  of  tie  approximations  are  given  by  Gaver, 
Jacobs  and  Latouche.  [Ref.  3]  The  approximations  will  be 
compared  with  the  results  frcir  simulation  to  study  their 
accuracy. 

As  mentioned  befcre,  the  Central  Limit  Theorem  for  addi- 
tive functionals  of  Harkov  processes  allows  the  conclusion 
that  the  accumulated  work  accomplished  in  time  t'  of  a  job 
requiring  a  large  amount  of  processing  time,  T,  is  approxi- 
mately normally  distributed.  This  in  turn  allows  the 
conclusion  that  the  corresponding  response  time  is  also 
approximately  normally  distributed.  Hence,  we  will  start  by 
considering  W(t*)r  "the  total  work  expended  by  the  computer 
on  the  tagged  job  by  clock  time  t'  after  its  arrival,  given 
that  the  tagged  job  requires  exactly  T  time-units  of  work 
for    completion. 

It  is  observed  that  if  when  a  job  arrives  there  are 
X(0)  =  j  customers,  including  the  new  arrival,  present  in 
the   system    for    processing,    then: 
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W(t«)     =      J   (r  (X^(u))/X^(u))du    ,    X^(0)     =    j    >1,  (4.1) 


where    X.  (t)       is      the    numbar    of    jobs   at    the      service    stag^    at 
clock    tiie    t. 

From  this  an  appropriate  central  limit  theorem  for  w  (t) 
can  be  established  by  using  results  for  finite  fcirth-and- 
death  models  [Ref.  8]  or  by  making  use  of  the  theory  of 
cumulative  processes.  [ Bef .  9]  We  note  here  that  the  latter 
development  of  the  central  limit  theorem  is  adaptable  to 
ttodels   mere   general    than  the   simple    birth-and-death    process. 

In  the  case  in  which  the  system  is  in  heavy  traffic  we 
can  approximate  ^X^(t);t>0  3  t»y  3-^  Ornstein-Uhlenbeck 
process,  see  e.g.  Iglehart.  [Hef-  10]  The  process  W(t*)  is 
then  approximated  by  an  integral  of  an  Ornstein-Uhlenbeck 
process.  A  normal  approximation  for  the  response  time 
distribution  then  follows. 

After  deriving  seme  formulas  for  the  above  two  methods 
cf  approximation,  we  will  make  comparison  for  goodness  of 
fit    of   those  approximations    to   simulation   data. 

B,       IPPRCXIHATIOH    BY    CENTRAL    LIMIT    THEOREM 
1.      A  Central  Liffit   Theorem   for   W  ( t) 

Dnder  Markov  assumptions  throughout  the  processor- 
sharing  system,  the  number  cf  jobs  being  at  service  stage  at 
clock  tine  t,  X^Ct),  is  a  finite  ergodic  stationary  time 
reversible    Markov  chain. 

If  we  define  a  function  f  (X  (t) )  =  r  (X  (t)  ) /X  (t)  ,  then 
as  outlined  in  Keilscn  [Hef.  8]  the  process  in  eguation 
(U. 1)  may  te  proven  in  a  variety  of  ways  to  be  asymptoti- 
cally normal  in  distribution  for  large  t.  Hence,  the 
accumulated  accomplished  wcrJc-time  at  time  t,  W(t), 
satisfies  a   central    limit   theorem. 
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In  crder  to  apply  the  cantral  limit  theorem  derived 
ty  Keilscn  we  will  have  to  redefinii  the  inf initesim?  1  gener- 
ator according  to  the  number  of  jobs  in  system  without 
including  the  tagged   one. 

Ihe   relevant   generator   is   now 


X'  (t)     =    j >    XMt+h)    =    j+1    :    X-    h+o(h) 

4^1 


(U.2) 


for    j    = 


— ->   X«  (t+h)    =    j-1    :    ^-^^hj/CJ+D+ofh) 

— ->  XMt+h)    =    j        :     1- (Xj4,^-|^j>,J/(J+1))^'  +  o(^) 

0,  1,..  .  ,  N»=N-1. 

The    process    in  equation    (U. 1)    then    becomes 


w(t)   =    5  f  (x«  (u))ai]. 


(^.3) 


where   f(J'{u))    =   r  (X  '  (u) +1)  /  (X  «  (u)  +  1)  . 

We    can    now    express    a   statement   for    the  central    limit 
theorem   as    : 


W(t)    -    ft >   N(0,1),   as  t >  ^ 


(4.U) 


where   the   constants     -7    and      ^2   are   such   that 


] 


1    -  2f(J)TT 


(^.5) 


>2     = 


2[f  (0)  ,f  (1)  ,..,,f  (N»)  ] 


o 


0 

z 

f  (0) 

• 

9 

« 

(^.6) 
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with  Z  being  a  matrix  defined  below 

A.  -" 


Z    =     ([I-A  +  L]  -I    -    L)/  Jf  , 


(4.7) 


I  is  ar  identity  matrix,  and  L  is  an  N  by  N  matrix  whose 
rows  are  steady-state  probabilities,  V"^' ^ '  ^^  ''-^^  birth  and 
death   process   with    rates   in     (U.2)  ,    i.e. 


L    = 


TT,    TT,   .  . 


n;  TT^ 


T^N* 


N 


(4.8) 


A  "^»  • .  .  "n-^'. 


and    S    is   a    matrix   defined  as   fellows    : 


^i     =  \+i-^  [^0*1(3/ (:;  +  i))»     ^    =   max  »)j 

(^o  =  X, ,    )),^'=   I^M^^VN)),     (again   with   rates   in     (4.2)). 

2.      A   Central  Limit   Theorem   for   res2onse   time,    5  (T) 

The  accumulated  acccmflished  work-time  at  clock  time 
t'  of  a  tagged  job  requiring  T  units  of  processing  time, 
8(t')#  increases  in  random  straight-line  segments  from 
W(0)  =0  until  W(t«)  =  T.  The  value  of  t'  here  will  be  the 
response  time  of  the  job,  R  (T) .  It  is  the  first-passage  time 
to   the    required    work    time.    So    we   can   state   the  following: 
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T 


P(W(t')     <    T)     =    P  (R  (T)     >   t').  (4.10) 

From    equaticns    (U.4)     and    (U.10),    we    can    derive,      by   the    sara^ 

standard  argument   of      r-snewal   theory   as    given  in    Karlin   and 

Taylor   [Fef.    11]   pp.       208-209,      the    following  statement   of   a 

central      linit      theorem      for   response      time,  R  (T) ,         as 
approaches   infinity,    i.e. 

R  (T)    -     (T/"^  )     >    N  (0,1)  ,    as    T >  oO  .  (4.11) 


C.       aPPBOXIBATIOH    BY    BEAVY    TBAFFIC    ANALYSIS 

New,  we  consider  the  processor-sharing  system  as  a 
machine  repair  model  in  which  X:  =  X(N-j)  ,  pj  ~  P»  ^^-^ 
r(j)  =  1  for  all  j's.  Let  N  the  number  of  terminals  te  large 
and  the  traffic  intensity  o  ,  which  is  defined  as  the  ratio 
of  the  expected  service  time  to  N  times  the  expected  inter- 
arrival      time,        be      a      fixed   value      less      than      one,        i.e. 

(_    =  }A/(KX)  . 

Under  the  above  conditions,  when  a  job  requiring  T  units 
cf  processing  time  enters  the  system  it  will  be  processed  in 
the  company  of  many  ethers.  This  indicates  a  system  with 
heavy  traffic  situation.  As  mentioned  earlier  in  the  intro- 
duction section  we  may  apply  the  properties  of  the  limiting 
diffusion   process  developed    by   Iglehart.      [Ref.    10] 

Therefore,  if  X^(t)  is  the  number  of  jobs  at  the 
processing  stage  at  clock  time  t,  then  X^(t)  can  be 
approximated  by    a   diffusion    process   as   follows: 

X^(t)     =    Na(t)     +/N".Y(t)  ,  (4.  12) 


ao 


where  a  (t)  is  a  deterministic  function  of  time  and  whsn  t 
approaches  infinity  it  has  a  finite  limit,  i.e.  a  (oo)  =  1-Pf 
and  ^Y(t)^  is,  for  the  present  model,  a  particular 
Ornstein-Uhlenbeck    piccess. 

The  accumulated  ccmpleted  work-time  by  fixed  time  t'  of 
a  tagged  job  requiring  T  units  of  processing  time  in 
equation    (4.1)     becomes 

W(t')    =    f  du/X^(u)    =     Jdu/CNaCu)*/?.^  (u)  )  .  (^.13) 

O  o 

Next,  we  apply  the  approximation  and  expand  the  expres- 
sion in  (4.13)  to  seccnd  order  terms  in  N;  then  assume  that 
the  tagged  job  arrives  when  the  system  is  in  steady  state  so 
that  we  can  use  the  finite  licoit  of  a  (ao)  =  ''"  ^  ^^  place  of 
a(u)  .    The   approximaticn   is    now: 

f  t' 

W(tM     =     jdu/(N{1-^))     -     (/T/CN  (1-D)  ]2)    I  Y(U)du,  (4.14) 

O  O 

for   0    <    t«    <  t. 

Hence,  the  expectation  of  accumulated  amount  of  wcrk- 
time  ccmpleted  on  the  tagged  job  is  approximately 
tV(N(1-D))  ,  and  the  actual  distribution  of  total  work  dene 
is        alsc  approxiirately        Gaussian         (integral  of        an 

Crnstein-Dhlenbeck  process),  where  the  Gaussian  property 
results  from  the  assumption  of  many  accompanying  jots,  and 
not  necessarily  because  the  tagged  job  requires  a  Icng 
processing    time. 

fls  t»  approaches  infinity,  we  can  evaluate  (4.14)  and 
show  that  E[  3  Y  (u)  du]  =  0,  and  VarC  J  Y(u)  du]  =  (2U/(NA2))  t» . 
So  the  normal  approximation  to  accumulated  completed  work 
time,    W(t*),   has  the    parameters: 

T     =1/(N(1-^)),       (T^   =    2  ji/(  xnN(l-P)  ]♦)  . 
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By  r-rascning  the  same  way  as  to  obtain  a  central  liirit 
theor€ir  for  response  time  from  a  known  approximated  normal 
distribution  of  accumulated  completed  work-time  for  a  tagged 
job  r€quiring  T  units  of  processing  time,  we  can  derive  a 
normal  approximation  for  the  distribution  of  response  time 
as   having   the   parameters  as    follow: 


E[  R  (I)  :    =    N(1-p)  T,  (4.  15) 


Var[R(T)]    =    2  MT/(  VN  (1-^))  .  (U.16) 

We   can    also     improve   the  value    of   the    variance      by    using   the 
formula   below: 

Var[R(1)  ]   =  [2|aT/(Xs)  ]j    ,  (4.  17) 

r  -sT 

where    s   =  XN  -  u      and  3    =    1    -   [  (    1    -   e        )/(sT)  ]. 

D.       CCMPaSISON    TO   SIEOIATION    DITI 

He  will  consider  some  particular  simulation  results  from 
a  system  consisting  cf  10  terminals  and  one  processor  in  the 
cases  of  light  traffic  and  heavy  traffic  to  make  comparison 
to   ncrmal   approximaticns  described   in    previous  section. 

Pirst  we  can  use  the  measures  of  skewness  and  kurtosis 
of  the  response  time  resulting  from  simulation  data  to 
roughly  assess  the  degree  of  normality  or  non-normality.  We 
know  that  if  a  distribution  is  symmetric  its  skewness  will 
te  zero  and  for  the  normal  distribution  its  kurtosis  has  the 
value    3.      However,       even   if      a   distribution  of  the   simulated 
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response  time  has  the  measures  of  skewness  and  kurtosis 
close  to  these  of  the  normal  distribution,  it  does  net  imply 
that  the  distribution  is  necessarily  normal.  It  only 
suggests  that  a  normal  distribution  may  be  a  reasonable 
approximation. 

Secondly,  we  will  compute  the  empirical  distribution  of 
the  simulation  data  at  various  quantiles  of  the  normal 
distribution  whose  mean  and  variance  are  approximated  by 
either  central  limit  theorem  or  heavy  traffic  analysis 
(limiting  diffusion) .  For  example,  to  compare  the  one-tenth 
quantile  of  the  approximated  normal  distributions  to  the 
simulated  response  time  at  the  initial  system  state  j,  we 
first  ccirpute 

S.io  "  Approx.  Mean  +  (Approx.  Std.  Dev.)  (Z.»o) 

where  Z.io  is  the  (1/10)th  quantile  of  the  standard  normal 
distribution.  We  then  determine  the  conditional  relative 
frequency  of  the  simulated  response  time,  given  the  initial 
system   state  is    j,    as 


r.f.;(E.io)    =    No.    of   simulated   response   rime  <    R.io. 

Nc.    of    replications 

Se  then  use  the  distribution  q*  in  (2.4)  to  remove  the 
initial  state  condition."  Hence,  we  obtain  the  one-tenth 
quantile  of  the  simulated  response  time  (corresponded  to  the 
normal  approximations).  We  may  also  compute  the  standard 
error   of   the  astimated  quantile   by   taking   the   square   root   of 

Var(F)    =    (2.g:^P;  (1-P;))/K. 

where  p-  =  r.f .  •  (R.io)  and  K  =  number  of  replications  used  in 
simulation. 


43 


New  consider  a  system  of  10  terminals  with  arrival  ratf: 
X=  15  and  service  rate  |>  =  100.  The  expected  number  of 
activ€   terminals  is,    therefore, 

E[X(t)]    =    10(1-  (100/150))     =    3.3333    , 

which    indicates    a    light   traffic   situation. 


TIBLE    V] 

Ccmparison    of 

Siaulatioi 

I   Data 

.   to   Normal 

.   Quar 

.tiles 

N    =    10,  X    = 

=    15, 

U   =    100 

0.0100 

Nort 

as.1 

•JO 
0.0 

-25 
.123 

•50 
.503 

.75 
.887 

•90 
.995 

•95 
1.0 

•99 
1.0 

CLT 

HTA 

I 

0.0 

0.0 

.361 

.94  8 

1.0 

1.0 

1.0 

HTA 

II 

0.0 

.102 

.361 

.677 

.909 

.972 

.999 

0.0250 

CLT 

.042 

.21  1 

.487 

.806 

.96  7 

.994 

1.0 

HTA 

I 

0.0 

.01  2 

.334 

.832 

.996 

1.0 

1.0 

HTA 

II 

0.0 

.094 

.334 

.668 

.914 

.977 

1.0 

0.0500 

CLT 

.ce3 

.232 

.486 

.766 

.93  8 

.977 

.999 

HTA 

I 

0.0 

.032 

.300 

.737 

.97  0 

.998 

1.0 

HTA 

II 

o.c 

.067 

.300 

.649 

.916 

.973 

1.0 

0.0750 

CLT 

.082 

.241 

.494 

.766 

.922 

.967 

.997 

ETA 

I 

0.0 

.033 

.266 

.  688 

.94  8 

.991 

1.0 

HTA 

II 

.001 

.049 

.266 

.630 

.900 

.969 

1.0 

0.1000 

CLT 

.C97 

.243 

.483 

.761 

.919 

.  96  9 

.998 

HTA 

I 

.OCO 

.027 

.238 

.647 

.934 

.987 

1.0 

L     

HTA 

II 

.001 

.037 

.238 

.603 

.893 

.972 

1.0 
.    _    —      J 
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TABLE    ?II 

CciBfa] 

cison    of 

Siaulatioi 

I   Data 

to  Normal 

.   Qua: 

.tiles 

N 

=    10, 

X  = 

=    25, 

l^  - 

100 

Tiraj 

Normal 

•10 

•25 

•50 

•  21 

•90 

.95 

•ii 

0.0100 

CLT 

.042 

.153 

.447 

.854 

.997 

1.0 

1.0 

HTA 

I 

.048 

.158 

.434 

.  826 

.990 

1  .0 

1.0 

HTA 

II 

.  1C6 

.224 

.434 

.721 

.911 

.975 

1  .0 

0.0250 

CLT 

.077 

.191 

.453 

.80  4 

.975 

.  998 

1.0 

HTA 

I 

.084 

.192 

.438 

.774 

.955 

.993 

1.0 

ETA 

II 

.  104 

.216 

.438 

.729 

.917 

.976 

1.0 

0.0500 

CLT 

.C92 

.215 

.454 

.769 

.951 

.990 

1.0 

HTA 

I 

.C95 

.21  2 

.435 

.728 

.927 

.979 

1  .0 

HTA 

II 

.  1C8 

.22  4 

.435 

.707 

.909 

.965 

.998 

0.0750 

CLT 

.093 

.198 

.447 

.754 

.936 

.983 

1.0 

ETA 

I 

.095 

.193 

.419 

.713 

.908 

.967 

.998 

HTA 

II 

.  102 

.200 

.419 

.701 

.892 

.959 

.996 

0.1000 

CLT 

.  101 

.236 

.474 

.756 

.933 

.976 

.999 

HTA 

I 

.  102 

.226 

.448 

.711 

.898 

.95  8 

.997 

HTA 

II 

.  1C6 

.232 

.448 

.704 

.891 

.953 

.996 

1               -    _    . 

_             • 

Table  III  shows  the  values  of  skewness  and  ncrmal 
kurtcsis  cf  the  response  time  of  a  tagged  job  for  various 
work-time  requirements.  These  values  are  quite  small 
especially  for  large  work-time  requirements.  It  indicates 
the    possibility    of    a   successful   normal  approximation. 

Table  VI  shows  hew  the  simulated  response  time  of  a  job 
requiring      some        processing      time        units      is        distributed 
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comparing  tc  the  various  quantiles  (  .10,  .25,  .50,  .75, 
.90,  .95,  .99  )  of  the  normal  distributions  approximated  by 
central  limit  theorem  and  the  two  heavy  traffic  (limiting 
diffusion)     approaches    (HTA    I   is    (4.16),    HTA   II   is    (4.17)). 

we  see  that  in  this  situation  the  limiting  diffusion 
apprcximaticn  for  normality  of  the  distribution  of  response 
time  is  net  so  good  an  approach  even  for  large  amount  of 
processing  time  requirement.  This  is  easily  anticipated 
since  the  system  has  only  an  expected  proportion  of  one- 
third  of  its  terminals  active.  However,  the  central  limit 
theorem  seems  tc  work  pretty  well  when  the  required  work 
time    t€ccmes  very   larce. 

Let's  consider  a  new  system  with  arrival  rate  X  =  25 
and   the      service   rat€     ^     =    100,      with      N    =    10  again.  The 

expected   number    of    active  terminals    is    now 

E[X(t)l   =    10  (1- (100/250)  )     =    6, 

which    indicates    a   mod€rately   heavy   traffic   in   the    system. 

Table  IV  provides  us  some  good  feelings  about  the  meas- 
ures cf  skewnesses  and  normal  kurtosises  not  being  too  far 
from  those  cf  actual  normal  distribution.  Now,  observe  the 
table  VII  which  shews  the  distribution  of  the  simulated 
response  time  of  a  tagged  job  for  various  work  time 
requirements  comparing  to  the  various  quantiles  of  the 
normal  distributions  approximated  by  central  limit  theorem 
and    limiting  diffusion  approaches. 

We  see  that  the  limiting  diffusion  methods,  in  this 
case,  wcrk  pretty  well  even  for  small  work-time  require- 
ments. The  one  with  second  formula  (4.17)  of  approximating 
the  variance  works  better  than  the  other,  because  it 
provides  a  smaller  standard  deviation.  The  central  limit 
theorem  approximation  still  works  very  well  when  the  wcrk 
time    requirement   becomes  large. 
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TABLE    VIII 

-      T 

Ccmparison    of 

Simulatior 

I   Data 

L   to   Normal 

.   Quantilss 

! 

N 

=    25, 

X  = 

=    10, 

P    = 

100- 

Tijre 

Normal 

•JO 

•25 

.50 

•25 

•10. 

'21 

•11 

0.0100 

CLT 

.C20 

.150 

.456 

.859 

.987 

.999 

1.0 

HTA 

I 

.  047 

.16  1 

.456 

.845 

.980 

.998 

1.0 

HTA 

II 

.  1C9 

.233 

.456 

.727 

.908 

.965 

.997 

0.0250 

CLT 

.070 

.192 

.460 

.799 

.96  1 

.992 

1.0 

HTA 

I 

.082 

.204 

.460 

.780 

.94  8 

.986 

1.0 

HTA 

II 

.  112 

.233 

.460 

.730 

.910 

.  967 

.997 

0.0375 

CLT 

.067 

.21  2 

.470 

.784 

.94  8 

.986 

1.0 

HTA 

I 

.CS7 

.226 

.470 

.763 

.934 

.978 

.999 

HTA 

II 

.  115 

.24  3 

.470 

.731 

.910 

.964 

.997 

0.0500 

CLT 

.C69 

.210 

.462 

.778 

.94  0 

.982 

.999 

HTA 

I 

.C99 

.223 

.462 

.760 

.927 

.  976 

.999 

HTA 

II 

.  Ill 

.236 

.462 

.734 

.910 

.963 

.997 

0.0625 

CLT 

.090 

.220 

.467 

.772 

.933 

.977 

.999 

HTA 

I 

.  ICO 

.233 

.467 

.751 

.917 

.968 

.998 

HTA 

II 

.  112 

.244 

.467 

.727 

.903 

.960 

.997 

N 

=    40, 

X   = 

=    10, 

K     = 

100 

Timg 

Normal 

-JO 

-25 

•50 

.75 

.90 

.95 

•11 

0.01CO 

CLT 

.072 

.198 

.477 

.789 

.954 

.988 

1.0 

HTA 

I 

.076 

.203 

.477 

.784 

.949 

.  986 

1.0 

HTA 

II 

.  110 

.243 

.477 

.739 

.902 

.961 

.997 

0.0375 

CLT 

.094 

.224 

.477 

.749 

.917 

.966 

.997 

BTA 

I 

.098 

.227 

.477 

.743 

.912 

.963 

.996 

HTA 

II 

.  106 

.236 

.477 

.736 

.90  0 

.958 

.995 

0.0625 

CLT 

.097 

.232 

.482 

.748 

.917 

.965 

.997 

BTA 

I 

.  100 

.236 

.482 

.744 

.909 

.962 

.997 

ETA 

II 

.  105 

.241 

.482 

.737 

.903 

.957 

.995 
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The  above  rasults  for  the  two  situations,  one  light 
traffic  and  another  loderately  heavy  traffic,  l^ad  tc  th=! 
conf irmaticn  that  for  a  tagged  job  requiring  large  amount  of 
processing  time  the  distribution  of  response  time 
approaches,  asymptotically,  normality.  In  heavy  traffic  case 
the  limiting  diffusion  approximations  seem  to  work  better 
than  the  central  limit  theorem  approach..  They  do  not  work 
well  at  all  when  the  system  has  the  terminals  active  lass 
than  a  half  of  its  full  capacity. 

Tc  conclude  this  chapter  we  show  some  more  results  in 
comparing  the  approximated  normal  guantiles  zo  the  values  of 
simulated  response  times  in  table  VIII  for  different 
(larger)  number  of  terminals  and  various  transitional  rates. 
We  can  see  easily  that  as  the  number  of  terminals  is  large 
the  distribution  of  simulated  response  time  approaches  the 
approximated  normals  more  rapidly.  The  heavy  traffic  apprcx- 
imaricn  seems  tc  work  better,  in  these  cases,  than  the 
central  limit  theorem  approach,  especially  for  small 
required  wcrk-tiie.  This  corresponds  to  our  observation  that 
the  central  limit  theorem  requires  large  work-time  require- 
ment to  te  a  gocd  approximation,  while  the  only  condition 
that  the  heavy  traffic  approximations  require  is  to  have  a 
certain  amount  of  jots  waiting  tc  be  served  at  any  instant. 
Finally,  table  IX  shows  the  mean  and  standard  deviation  of 
the  response  time  computed  by  the  central  limit  theorem  and 
heavy  traffic  approximations  for  all  the  cases  that  we  have 
teen  studying  the  comparison  of  the  guantiles. 


46 


TABLE    IX 

Apprcx.    Mean    and   Std,    Dev.    for   One-Type   Model 

N    =    10,     X    =    15,     1^    =    100 

CLT  HTA    I  HTA    II 

Time        M^an       Std.Eev      M^an      Std.Dev.       Mean      Std.Dev, 


0. 

0100 

.0404 

.0323 

.0333 

.0516 

.0333 

.0238 

0, 

0250 

.  1010 

.0510 

.0833 

.0816 

.0833 

.0535 

0. 

0500 

.  2019 

.0722 

.  1667 

.1155 

.1667 

.0919 

0. 

0750 

.3029 

.0884 

.2500 

.1414 

.2500 

.1216 

0, 

1000 

.4038 

.  1020 

.3333 

,1633 

.3333 

.  1462 

N  =  10, 

X  =  25 

'   P  = 

100 

0. 

0100 

.0605 

.0245 

.0600 

.0231 

.0600 

.0160 

0. 

0250 

.  1513 

.0388 

.  1500 

.0365 

.1500 

.0314 

0. 

0500 

.  3027 

.0548 

.3000 

.0516 

.3000 

.0481 

0, 

0750 

.454  0 

.0672 

.4500 

.0632 

.4500 

.0604 

0. 

1000 

.605  3 

-0776 

.6000 

.0730 

.6000 

.0706 

N  =  25, 

X  =  10 

'    \^     = 

100 

0, 

.0100 

.  1500 

.0390 

.1500 

-0365 

.1500 

.0254 

0. 

.0250 

.375  0 

.0617 

.3750 

,0511 

.3750 

.0497 

0. 

0375 

.5625 

.  0755 

.5625 

.07  07 

.5625 

.0641 

0. 

.0500 

.7500 

.0872 

.7500 

.0816 

.7500 

.0760 

0, 

.0625 

.9375 

.0975 

.9375 

.0913 

.9375 

.0863 

N    =    40,  A    =    10,    VA     =  100 

0.0100    .3000       .0264  .3000       .0258  .3000       .0213 

0.0375    1.1250    .0512  1.1250    .0500  1.1250    .0477 

0.0625    1.8750    .0661  1.8750    -0646  1.8750    .0628 
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'•    MODEL    FOR    A    SISTEfl    WITH    TWO    TYPES    OF    TERMINALS 

A.       INTRCDDCTION 

The  processor-sharing  model  we  have  been  describing  so 
far  deals  with  a  computer  system  having  a  single  exponential 
service  time  distritution  only.  To  generalize  it  we  will 
consider  a  model  of  a  computer  system  that  consists  of  one 
Central  Prccessing  Unit,  H  terminals  of  type  I  and  N  termi- 
nals of  type  II.  Type  I  terminals  submit  jobs  to  be 
processed  by  the  processor  at  rate  X,,  which  need  an 
expected   amount    of    work    1/{-*».  Likewise    for  type    II   termi- 

nals, the  arrival  rate  to  the  processor  is  X^,  and  the 
expected  work  needed  is  l/jJ^j,.  Think  times  and  amounts  of 
work    requested    are   tc   be  independent   and  exponential. 

This  computer  system  may  be  viewed  as  the  one  having  the 
ability  to  process  two  types  of  jobs.  Each  type  of  jobs  must 
be   submitted  from   its  corresponding   type   of    terminal. 

The  expected  response  time  of  a  tagged  job  that  requires 
T  units  of  processing  time  will  be  derived  by  the  same 
approach  we  used  for  the  one-type  model.  However,  now,  we 
have  tc  consider  conditioning  the  given  tagged  job  to  be 
either  type  I  or  type  II.  The  continuous  time  Markov-chain 
to  be  considered  for  the  model  is  bivariate,  with  one  vari- 
able being  the  number  of  jobs  of  type  I  being  processed  and 
the  ether  being  the  number  of  jobs  of  type  II  being 
processed.  The  response  time  of  the  tagged  job  will  depend 
on   the   numbers    of   both  types   of    jobs   in   the   system    with   it. 

Once  we  obtain  the  expected  conditional  response  time 
given  the  initial  condition  of  how  many  others  as  described 
above,  we  will  have  to  remove  those  conditions  by  the 
steady-state  distribution  of      the  tagged    job   given      it    is   of 
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typo  I  or  cf  type  II.  The  application  of  this  steady  statr 
distributicr.  to  the  conditional  response  time  will  enable  as 
to  ccmpute  the  mean,  standard  deviation,  and  higher  moments 
cf  response  time  of  a  tagged  job  that  requires  T  units  of 
work  time,  and  henc€  the  skewness  and  kurtosis  as  w^ll, 
Ihese  values  can  help  judge  the  goodness  of  the  normal 
apprcximaticn. 

Simulation  will  te  used  to  generate  the  conditional 
response  times  as  before.  The  steady  state  distribution  of 
the  tagged  job  will  be  used  to  compute  estimates  of  the 
mean,  variance,  skewness  and  kurtosis  of  response  time  for  a 
tagged  job  requiring  T  units  cf  processing  time.  Finally,  we 
will  describe  an  approach  for  normal  approximations  by  the 
central  limit  theorem,  and  by  a  heavy  traffic  approach  as 
for  the  one-type  model,  and  study  their  accuracy  through 
simulaticn. 

B.       SIEAEl-STATE    DISTEIBUTIOH 

When  the  system  has  two  types  of  terminals  to  deal  with, 
the  direct  derivation  to  find  differential  equations  cr  to 
apply  the  Laplace  transforms  for  the  conditional  response 
time  of  a  tagged  job  is  much  more  complicated  than  when  the 
system  has  cnly  one  type  of  terminal.  Since,  we  now  have  to 
consider  net  only  the  condition  that  the  job  is  tagged  to 
find  how  many  of  them  already  present  in  the  system  tut  also 
the   condition  that    tte    job    is   of    what    type,    I   or    II. 

However,  under  the  processor-sharing  concept  with  Markov 
assumptions,  exponential  think  times  and  work  request  times, 
it  will  not  be  too  hard  to  simulate  the  expected  conditional 
respcnse  time,  given  that  the  job  is  one  of  the  twc  types, 
and  that  it  initially  finds  i-1  others  of  the  same  type  and 
j  of  the  other  type  present  in  the  system.  But  then  to 
remove      these   conditions      we   will      have   to      apply   the      joint 


51 


stead  j-sta t<=  distributions  of  the  number  of  jobs  present  in 
the  system  just  aft€r  the  tagged  job  enters,  given  the 
tagged  job  is  of  specified  type.  The  similar  compu-^aticn  is 
perfcrmsd    for   the   case   the    tagged    job    is    of   another    type. 

let  W  and  N  be  the  number  of  type  I  and  type  II  terii- 
nals  respectively.  If  Xj^(t)  is  the  number  of  type  k  jets  at 
clock  tine  t  for  k  =  1,2,  then,  before  a  tagged  jcb  enters 
and  let  (i,j),  for  i  =  0,1,2,  ...  ,M  and  j  =  0,1,2,  ...  ,N, 
be  the  system  state  i  type  I  jobs  and  j  type  II  jobs  being 
processed,  the  limiting  distribution  of  the  number  of  type  I 
and    type   II    jobs   in    the   system   is 


TT(i,j)    =    lim    FC  (X,(t)  ,X,  (t))     =    (i,j)]. 
t-^oo 

Consider  the      local   balance   equations   for     type   I   tagged 
jobs: 


TT(0,0)mX,  =    f-»,TT(irO) 


TTdrO)  (M-i)X,  =    1^,11(2,0) 


flKirO)  (M-i)Xj    =     M,TT(i-H,0)  (5.1) 


which   imply   that,    for   i   =   0,1,2,... ,M,      the   probability  that 
the   system    is   in  state    (i,0)    is 

-fTCirO)    =    M(M-1)...  (M-i+1)  (X/Pj)''  TT(0/0)  •  (5.2) 
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likewise,   we  can   derive  the  same  thing   for  type  II  tagged 
jobs: 


frTor  1)  (N-i)X^  =   u^TTro,2) 

TRO, j)  (N-j)X^  =   Uj^TT(Orj-n)  (5.3) 

which    in   turn   imply    that,    for    j   =   0,1,. ..,n, 

TPOrJ)    =    N(N-1)...  (N-j+1)  (X^/l-tJ*^  TT(0,0)  .  (5.4) 

other    local   balance    equations   are    : 


/%• 


TT(irO)NX^  =  J_|>i^Tr(i,1) 


t+« 


TTdrl)  (N-1)X,      =    2   M,TT(i.2) 


TT7i,  2)  (N-2)  X,      =  J_fAjT(i  r 


3)  (5.5) 


THi.J)  (N-j)X^   =    (j^i)^,TT(i>  J^T)' 

Finally  we  can  comfortably  guess,  from  the  equations  (5.5), 
the  steady-state  distribution  of  the  total  number  of  jcbs 
(of  bcth  types)  before  the  tagged  job  enters  as,  for 
i  =    0,1,.. .,M   and   j    =  0,1,. ..,N, 
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TT(irJ)    =    r''*^\M(H-1)...(M-i+1)  (X/^») 


X    N  (N-1)  ...  (N-j+1)  (X^/|A^r    TT(0,0)  .  (5.6) 


This  distribution  alsc  satisfies  the  full  balar.cs  ^quaticns. 
The  steady-state  distribution  of  the  number  of  jobs  in  the 
system  can  be  found  by  choosing  TT(OrO)  sc  -^.hat 
S"^TTTirJ)  =  1-  Mere  details  can  be  found  in  Gaver  and 
Jacobs.      [Eef.     12] 

The  steady  state  distribution  of  the  entering  tagged  job 
being  of  type  I  and  there  being  i  jobs  of  type  I  and  j  jobs 
cf   type    II    processing  when    the   tagged    job    enters    is 


q{i,j,I)      =   k  TT(i-1/J)  (M-i)X,r 


(5.7) 


and  fcr  type  II  tagged  job 


/N«/ 


q(i,j,II)     =    krr(i,j-1)   (N-j)X2_r 


(5.8) 


where    k   is    selected    so   that   TE  2[  g  (i»  j#  I)  ■♦•q  (i»  jr  II)  ]   =    1. 

Uo  i-o 

Similarly,  the  conditional  distribution  of  there  being  i 

jobs  cf   type  I  and   j  jobs  of   type  II  processing   when  the 
tagged  job  arrives  given  the  tagged  job  is  of  type  I  is 


/>^ 


q    (irj)  =  k    TT(i-i,j)  (M-i)X,» 


(5.9) 


where    k      is   chosen    so   that    2"Sg    (irj)    =    1. 
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C.       A    CENTPiL   LiaiT    TBEOREM    FOB    THE    RESPONSE    TIME 

In  this  section  ws  will  present  a  central  limit  theorem 
for  the  conditional  distribution  of  the  response  time  of  a 
tagged  job  requiring  T  units  of  work  given  it  is  of  a 
particular    type.  Mere   details   can     be   found  in      Gaver   and 

Jacobs.      [Ref.     12] 

In  what  follows  we  will  assume  the  tagged  job  is  of 
type  I.  Let  X  (t)  be  the  nuniber  of  type  I  jobs  (excluding 
the  tagged  one)  being  processed  at  work  time  t  ;  that  is 
when  the  tagged  job  has  acquired  t  units  of  work.  Then 
^(X  ,  (t)  ,  X,  (t) )  ;  t>0  "^  is  a  continuous  time  Markov  chain  with 
rates 

(irj)    — >    (i+1rj)     :    (M-(i+1))X^(i+j^-1)  ,    0<i<M-1       (5.10) 


(i,j)    — >    (irJ+1)     :     (N-(j+1))X^(i+j*1)  ,    0<j<N  (5.11) 


(i,j) >    (i-1,j)     :    ijJlj,  1<i<M-1       (5.12) 


(irj)    — >    (irj-1)     :    j^^,  1<j<N.  (5.13) 


Similar  arguments  to  those  used  in  deriving  (5.6)  shew  that 
the  limiting  distribution  TT(if  j)  for  the  Markov  chain 
having   rates    (5.  10)  ,  (5. 1 1)  ,  (5 .  12)    and    (5.13)     is   of    the    form 

TT(i#i)     =M(M-1)    (K-2)...   (M-i)   (X,/f4»)^  (5.  lU) 


X    N  (N-1)...  (N-j  +  1)  (X/fA^)*^    nXOrO) 
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K    hi 

where     Tr(0,0)    is  chosen   so    that      2!^TT(i»J)    =    1« 

The   response  time   of   the      tagged    job    which   requires    work 


1  is 
Rd) 


■J 


[X,(u)+X^(u)  +1]dii. 


(5.  15) 


an   integral   of   a   function   of   a   continuous   time  Markov    chain. 
As      a      result      the      central      limit,      theorem      of      Keilsor. 

[Sef.    8]     applies  to      give      that      as   T >  oO  ,         there      are 

constants   m   and    (T   such   that 

R (T)    -    mT 


0-^ 


has  an   asymptotic  ncrmal   distribution  with 
variance  one.   In  this  case 

m    =  Z^(i+j  +  1)  Tr(i,j)  . 


mean    zero      and 


(5.16) 


The    variance    ^2   is    computed  as    follows. 

Let    C      be  the      infinitesimal    generator      of    (X  ^  (t)  ,  X^(t) ) 
with      system     states      in     the      order,         i.e.         (0,0),        ..., 
(M-1,C)  ,  (0,1)  ,     ...     ,([«-1,1),    ...     ,(0,N),       ...    ,(M-1,N).    Then 
C  is    an   Mx  (N+1)     square   matrix    having   the   form 


Q   = 


A-   R^  0      0      0 
o     o 

M,     A,    R,     0      0 


0      M^    Aj^    R^    0      . 


0      0      M3     A^    S3    . 


•       »     * 
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wher€   the      non-zaro  elements   are      th^s  rates   of     these   system 

states. 

let      X'     be      the  iraxinium   absolute  value      of    a      diagonal 

element   of   Q,      then  ty   unif ormization  of   the   chain    we    obtain 

a   matrix   A    =  I    ■*■   2.  Q. 

z 
let    f(i,j)    =   i+j  +  1,  TTj(i)    =    Tr(i,j),    fj(i)    =    f(i,j)       and 

(TTf)-.     =    2  TT.(i)f  .  (i)  .      Then   according      to   Keilscn   [Ref.    8] 

the      central  limit      theorem    variance      term,         f<^ ,      for      the 

integral     j  f  (X  ,  (u)  ,  X^^^  (u)  )  du    is   as    fellows. 


(j-s    =    2C  (TTf)^   ,  CTTf),    ,...,(TTf)^]    Z 


r  ^    "y 


h» 


fN- 


(5.17) 


where    2    =    1    [I-A+Ll'i    -    L   ,    and 

9 


L    = 


[tt^  tt,  . .  .  tt^ 


.TTo  TT,   .  .  .  TT„ 


(5.  18) 


If  we   define   X  =  (x  ,x  , 
since  I-fl  =  -1.  Q  /  we  have 


"^J 


=  [I-A.+L]  -If,        then. 


[-XQ  +  i]x  =   f 


(5.  19) 


Multiplying    both   sides   of    (5.19)         by    TT/      and  since     TIQ   =   0 
and   j^X   =    TJX,    we  then  have    TTX    =    TJf.    Thus    (5.19)     becomes 


1  CX   =   f  -    (TTf)  , 


(5.20) 


or,    better. 
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QX    =    -   ^(f  -     TTf)  .  (5.  21) 

We   car.   then   solve   equation     (5.21)    for    X   and   thus    the   central 
limit    theorem   variance     ^2    from   equation    (5,17). 


D.       HiA?I    TEAFFIC    APPBOXIHATICH    FOR    THE    RESPONSE    TIME 

As  before,  consider  a  ccmputer  system  consisting  of  M 
type  I  terminals  with  arrival  rate  X,  and  service  rate  ^j, 
and  N  type  II  terminals  with  arrival  rate  X^  and  service 
rate  pj_r€spectiv€ly.  In    this      section    we      will    present      a 

heavy  traffic  approximation  for  the  response  time.  More 
details  of  the  approximation  are  described  by  Gaver  and 
Jacobs.      [Ref.     12] 

let  I,  =  X,M,  Li  =  X^N  and  c  =  M/N.  To  simplify  the 
notations  used  in  deriving  heavy  traffic  mean  and  variance, 
we   define   the   following   expressions. 

First  we  solve  for  m^  which  is  the  positive  solution  of 
the   quadratic   equaticn; 

0    =    -L^Lj  c      +(p^-Lj)|A^L,  (5.22) 


*in,CL,2fi^MfA,-l,)(^,L^-^^L,).cL^L,^^] 
*m^2fI,(fA,L^.p^L,)  ], 

then    set   m^  =  [  in,U^  /  (L,  (1-m,  )  )  ]   -    m,  . 
Let   a,     =  -[L,  (1-m,)-p,-L,  (m,  +11.^)  ] 
a^   =  -[Li  (1-iE,)  ] 
b,    =  -[L^(c-mi)  ] 
b»    =  -[Li(c-iri)-JAi-Li(m,+mJ  ] 
<T,^  =     L,  (1-m,  )  (fflj  +  m^) +]^,|A^ 
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(5^=  L^  (c-m^)  (m, -nn^)+ir^u^. 

Now    put    Sq    =  (-(b^+a,  )+J(ba^+aj)  ^-4  (a,  b^-a^b,  )  ) /2 

and  S,    =  (-  (t^  +  aj  )-^(b^+a,  )2-4(a,  b^^-a^^b,)  ) /2 

(Not€   that    S  and  S      are  solutions   to   a    quadratic   equation)  . 


'Also    put     Aj.    =    • 


(So+t^)/(S^  -S^)     ;    p^^    =    b,/(S, -Sq) 


K 


M 


K 


Z2- 


(S^+a,)/(S,  -Sq) 
(S,  ♦t2_)/(S,  -Sq) 
(S,  +a,)/(S,  -S^) 


fi2. 


K 


i2L 


K 


XI 


=    a-/(S,  -So) 


=   -a,/(S,  -So) 


=   -b,/(s,  -So) 


h\    =       (bi-t,)/(a,  b^-a^b^)    =    (b^-b,)/(SoS,) 

^2=       (a,  -a2^)/(a,  b^-a^b,)     =    (a, -a^) /(S^S  , ) 

f>3l    =       («1,S,  +1)/(S^-S,  )     ;    p>^2_=       (^3j_Sj+1)/(So-S,  ) 

^^\    =   -(^3|So*i)/(So-s,)    ;    K32_  =   -(  tjiSo  +  D/fSo-S,) 
New,         let      X.(t)    =   number      of      type    i      jobs,         i   =    1,2, 
processing   at   work,    time   t    (tagged   job   not    included)  .    Suppose 
the   tagged    job    is  of   type  I.   Put 


Yj^(t)     =     (X.(t)-Mm.)/    M    . 


(5. 23) 


Then,    Y;  (t)      satisfies  the    following   stochastic   differential 
equations 


dYj  (t)     =    -a,Y,   (t)  +  (-a3^)Y2^(t)  ♦(TjdWj  (t)  , 


(5.  24) 


dY^(t)     =    -bjYj    (t)-  (-b2^)Y^(t)+  <r^dW^(t)  , 


(5.25) 


where      W    (t)      and      W    (t)      are    independent   Brcwnian   motions. 
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The  response  tims   for  the  tagged  job   requiring  -  'inits 
cf  processing  time  is 


'1 


R(t)  =  [X,  (u)+X,  (u)  ]du 


(5. 26) 


=    j[  yr  Y,  (u)  -^Mic,  ■^/M'   Y^(u)  +Mia2_]da 
0 

=   [M(inj^m^)  ]t    +/irj'[  Y,  (u)+Y^(a)  ]du. 

Let    Z(t)    =  J  [Y  ,  (u)  +  Yj^(u)  ]du.         Then    Z  (t)         satisfies   the 
stochastic    differential   equation 


dZ(t)     =    Y,(t)+Y^(t) 


(5.27) 


The  heavy  traffic  approximation  for  the  distribution  of 
R(t)  is  that  R  (t)  has  a  normal  distribution  with  mean 

[M(ni,  +  m^)  ]t 

and    variance  equal   tc   M(VarCZ(t)  ])  . 

Tc  derive  an  expression  for  VarCZ(t)  ]  we  will  apply 
results  found  ir  Arncld  [ Bef .  13]  to  solve  the  f cllcwing 
system  of  stochastic   differential  equations: 


dV(t)     =    AV(t)     +    BdW(t)  , 


(5.28) 


where    ^(t)    =  [  Y  ,  (t)  ,  Y^(t)  ,Z  (t)  ]   ,    dw^(t)    =   [  dw  ,  (t )  ,  dw^(t)  ] 


and 


A    = 


a. 

-a    2. 

0 

b» 

-^2 

0 

1 

1 

0 

B    = 


0       0 
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By   ccrcllary    (8.2.t^)      on  pag^    130, Arnold   states   ths    solution 
cf   equation    (5.28)    as   follows. 


■Sot.,,         S,t 


^ot    ^        ^,t 


^1   <^^     =    ^  fll^       *^H    ^        JY\   ^°^*l^P>|2.-       -"^li^        ^^2.^°^      ^^-2^) 


0 


ht 


S,  tt-^) 


]dW, (u) 


Y^(t) 


Sot  S,t  Sot  S.t 

^h\^      ^^a-,  ^      1Y»  <0^*Cpi2.s      -^K^j.^      lY^(O)      (5.30) 


d 


(  Se(.r-u)  SiCt-uY. 


(< 


SeCt-u>         s,ct-u) 


*l<3:ff>ri^'      '*^2.i^' 


]dW^(u)  , 


Sot  s,  t 


Z(t)    =  C  X'^j  +  p^^e**   +F^,  e^     ]Y,  (0) 


(5.31) 


,  ^  ^t  S,t 

t 


"Kf   ^32.*P3. 


5oCt-^>  4,Cb-U> 
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then    fcllcws  that 


Let    C,    =    ^i,*    p»3,€^    *f^i,  e  "■      a^'3   C^  =     532^f   p,^^.      ..32 


=  ^,,^  fc,i^*K_^^.     It 


Var[Z(t)  1   =   C2VarCY,(0)  ]+C2Var[ Y^(0)  ] 
+     2C^  Cj^  (Cov[  Y  ,  (0),Y^(0)   ]) 


(5. 32) 


f  1    ^  SoLt-u^  S.Ct-u) 


oO 


where 


Var[Yj(0)]    =     ^^afc  ^,,e^^K„  e'^'^^isdu 


(O 


+<f~\r  ft,j,e     "^^12,®      ]^^^ 


^<f jc  ^ 


00 


Var[Y^(0)  ]   = 


<r2][^i»e      >Ki,e      ]2du 


COV[Y^(0),Y^(0)  ] 


00 


=  cr. 


r  SoU  cu  So^  i.U. 
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Substitute  tha  integral  forms  for  7ar[Y,(0)],  Var[Y2.(0)]  and 
Cov[  Y  ,  (0)  ,Y^  (0)  ]  in  equation  (5.32).  It  remains  new  to  solv« 
the  siirple  integrals  to  obtain  a  formula  for  the  variance  of 
the    response   time    by    heavy    traffic   approximation. 

1.       SIMDIATION 

1 .       fllqcrith  m 

Practically,  the  simulation  for  response  time  in  a 
system  with  M  type  I  terminals  and  N  type  II  terminals  is 
perfcrmed  by  applying  the  same  procedure  as  for  the  one-type 
model.  This  means  that,  for  each  initial  system  state  of  a 
tagged  job  cf  each  type,  we  generate  the  exponential  arrival 
and  departure  times  tc  be  able  to  determine  the  next  system 
state  after  a  sojourn  time.  The  simulation  is  for  the  work 
time    process. 

If  the  minimum  of  the  two  exponential  times  is 
greater  than  or  equal  to  the  amount  of  work-time  require- 
ment, we  simply  determine  the  response  time  by  converting  it 
into  real  time  term.  If  not,  we  determine  the  next  system 
state,  the  work-time  remaining  to  be  accomplished  and  the 
accumulated  clock  tine,  and  generate  new  exponential  times. 
He  repeat  this  procedure  until  we  obtain  a  response  time  for 
each  initial  system  state  of  a  tagged  job  of  each  type.  Once 
we  obtain  those  conditional  response  times,  we  can  easily 
calculate  the  mean,  moments,  and  measures  of  skewness  and 
kurtosis  by  applyinc  the  steady-state  distribution  derived 
previously. 

We  now  describe  in  detail  how  to  simulate  a  condi- 
tional response  time,  given  an  initial  system  state  is  (i,j) 
and  the  tagged  job  is  of  type  I,  for  a  computer  system 
consisting  cf  M  type  I  terminals  having  Xj  ^^^  M\  as  arrival 
and  requested  work  rates,  and  N  type  II  terminals  having  X^ 
and  u^  as  arrival  and  requested  work  rates  respectively  ;  (i 
does    net   include  the   tagged    job)  . 
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In   units  of      work-time   the   arrival   rata      of    the   nsxt 
tagged    jcb    cf  either   type   is 

A    =    C  (W-(i+1)  )X^    +     (N-j)A^](i+j  +  1)  ,  (5.33) 


and    the    service    completion    rate  of   a    job   in   system    is 

D    =    [i^,    +    j^^l.  (5.3U) 

He,  then,  generate  two  exponential  times  wi-^h  parameters  A 
and    E.      Call  them   t»    and  t"    respectively. 

If    iin(t',t")    >   Wq  ,    then   set    the   response    time 

R(i,j,I)    =  c^    ♦w^d  +  j+l), 

where   c^   is   the    accumulated      clock   time     (initially   =   0)      and 

w^     is      the   amount      cf      work-time      remains    to      be      completed 
o 

(initially   =  T    work    time  requirement   of    the    jcb)  . 
If    min(tSt")    <   Wq,    set 

Wj,    =   Wq    -    min(t»,t") 

Cq    =   Cq   +   min(t«,t")  (i+j+1)  . 

If  min(t*,t")  =  t* ,  which  means  the  system  state  is  changed 
by  an  arrival,  we  generate  two  more  exponential  times  with 
parameters  (M- (i  +  1)  )  X,(i+ j+ 1)  and  (N- j)  X5('^'^j'^  "')  respec- 
tively. If  the  latter  quantum  of  time  is  less  than  the 
previous  one,  i.e.  an  arrival  of  type  II  job  occurs  first, 
the  system  state  changes  from  (i+1rj)  to  (i+1,j+1). 
Otherwise,  it  changes  from  (i+1,j)  to  (i-»-2,  j)  .  In  the 
contrary,  if  min(t',t")  =  t",  which  means  the  system  state 
is  changed  by  a  departure,  we  also  generate  two  exponential 
times      fcr      service      time      with      parameters      i  a.       and      j  a. 
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raspect  ively.  If  the  lattar  is  tha  minimum  of  th«r  two,  i.e. 
a  daparture  of  type  II  job  occurs  firsu,  the  system  s-ate 
will  then  change  frcm  (i,  j)  to  (i,j-1).  Oth^rwis^,  it 
changes   frcm    (i,j)     tc    (i-1,j). 

Eased  on  new  system  state  and  new  work-time  require- 
ment, we  repeat  the  same  procedure  until  W9  obtain  the 
corresponding  response   time. 

Note  that  we  will  have  in  total  M  times  N+1  response 
times  for  type  I  tagged  job  and  M+1  t.imes  N  for  type  II 
tagged  jet.  We  can  then  apply  the  steady-state  distributions 
q- (i ,  j)  and  q__(i,  j)  to  compute  the  mean,  variance,  skewness 
and  kurtosis  of  the  response  time  of  a  tagged  job  that 
requires  T  units  of  processing  time  as  for  the  one  type 
model . 

2.      Computation    cf   Simu lated      Mean,      Variance ,      Skewness 
1£^   Kurtosis 

a.      Simulated  Mean    Response   Time 

Let  Rj^(i,j,I)  and  R|^(i,j,II)  be  the  k-th  simu- 
lated conditional  response  time,  given  the  initial  system 
state  (tagged  jot  included)  is  (i,  j)  and  the  tagged  job  is 
cf   type   I   and   type    II  respectively. 

If  we  perform  K  replications  for  simulation  of 
response  time  at  each  initial  system  state,  then  the  mean 
response   time,    given    that   the   tagged    job   is   of  type    I,    is 

R    =Z2R(i,j,I)q_(i,j),  (5.35) 


Where   R(i,j,I)    =    (^H.  (i,  j,  I) ) /K. 
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t.      standard   Error    of   the   Mean   Response    Time 

Under        an        assumption      that        R.  (i,j,I)  and 

Ej^(i,j,II)  are  independent,  we  can  compute  the  variance  of 
the  estiniat<=d  mean  response  time,  given  the  tagged  job  is  of 
type  I,  based  on  the  value  obtained  from  equation  (5.35)  as 
follows. 


M    Is4 


Var(R)    =    l^S-VarCfd,  j,I)  ]q2(i,j) 


(5. 36) 


where    Var[R(i,j,I)]    =  [  2  (R.(i,  j,  I) -R  (i,  j,  I)  )  2  ]/K  . 

To  obtain  the  standard  error  we  simply  take  the 
square    root   of    the    expression    (5.36). 

c.      Variance   of   Simulated   Response    Time 

We  start  ty  computing  higher  central  moments  of 
respcn£<=  time,  given  the  tagged  job  is  of  type  I,  by 
applying  the  same  method  as  for  one-type  model.  The  second 
central  noment  which  is  also  the  variance  of  response  time 
may    be   computed,    based   on   simulation   data,    as   follows. 

k    M   NJ 

Var[R]   =   l222[  (I'.  (i/Jrl)-*?)  2q^(i,j)  ]  (5.37) 


=  i'Z^lC  (B.  (i,j,I)-B(i,j,I)) 
1^  ks|lso4«o       "^ 


♦     (R  (i,  j,I)-R)  2]q,(i,j). 
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d.      Skewness   cf   response   time 

The    skewn€ss   of    response    time    can   be    ccmput=d    by 
the    usual   formula,    i.e. 

where    U3  is   the    third  central      moment   and     (S"   is   the    standard 
deviation   of  the  response  time.  As    for   the   calculation   of 

the    variance. 


(5.38) 


=     l222.n5.    (irjrl)   -R(ir  jrD)    3 


+    3(B^(i,  j,I)-R  (i,  j,I)  )  2{R(irjrI)-R) 


+      (Jd,  j,I)-R)3  ]q      (i,  j)   . 

6.      Kurtcsis    cf   response    time 

The  kurtosis  is  defined  as  ^c^  ~  (M«/<f*)~3f 
where  p^^.  is  the  fourth  central  moment  and  <r  is  the  standard 
deviation   of  the  response  time.      As   before; 

K  hA   N 
pH    =    lZZZ(Ru(i'J'I)    -    R)*q^(i.J)  (5.39) 


and    ty  simple   pclynonial  expansion; 
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K.  VAK> 


U       =    l^^S."^  ^''^L^^'^j'^^  '^^^'^'^^^  * 
1    ^  K  |t--\  L-o  4:^0        *■ 


-»■    U  (F^(i,  j,I)-R  (i,  j,I)  )  3(R(i,j,l)-3) 


+    6  (B^(i,j  ,1)  -R(i,  j,I)  )  2(R(irjrI)-H)  2 


+     (E(i,j,I)-E)*]q     (ir  J)  . 


3  .      Numerical   Results 

Tables  X  and  XI  show  the  values  of  the  means,  their 
standard  errors  (numbers  between  parentheses  below  the 
leans),  standard  deviations,  skewness  and  kurtosis  of  the 
empirical  response  times  for  a  system  consisting  of  5  type  I 
terminals  and  5  type  II  terminals.  We  also  attach  the  values 
of  the  mean  and  the  standard  deviation  computed  by  the 
central  limit  theorem  and  the  limiting  diffusion  in  heavy 
traffic.  Those  values  are  computed  for  two  cases.  In  the 
first  case.  Table  X,  the  arrival  and  departure  rates  are 
Xi  =  30,  jA^  =  100  fcr  type  I  jobs  and  X^  =  20,  p^  =  50  for 
type  II  jobs.  But  in  the  second  case.  Table  XI,  those  rates 
are  in  reverse  order,  i.e.  X."=  20,  u^  =  50,  X,  =  30  and 
U2_=    100. 

We  see  that  the  results  shown  in  tables  X  and  XI 
indicate  that  in  both  cases  the  distribution  of  the  empir- 
ical response  time  of  a  tagged  job  that  requires  a  fixed 
amount  of  processing  time  is  about  the  same.  This  indicates 
that  the  distribution  of  the  response  time  is  almost 
independent  of   the    jet  type    of    the   tagged    job.      The   measures 
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TABLE 

X 

simulation    results   for 

a   two-type   model 

M    =    5,    N 

=    5,    Xj    = 

30,     X^  = 

20,     U^  =    100,    U^=    50 

Tim€ 

Mean 

Std  .D«=v. 

Skewn^ss      Kurtosis 

C.0100 

0  .  07  1  0  2 
(.00014) 

0.01365 

-0.80425      -0.77956 

CLT 

0.07156 

0.02038 

HTA 

0.  07  10  1 

0-01315 

0.0250 

0.  17  77  0 
(.00032) 

0.02676 

-0.87139      -0.73673 

CLT 

0.  1789C 

0.03222 

HTA 

0.  17  75  2 

0.02528 

0.0375 

0.26720 
(.00043) 

0.03506 

-0.93571       -0.70581 

CLT 

0.26835 

0.03947 

HTA 

0  -  26  6  2  £ 

0.03249 

C.0500 

0.  35671 
(.00054) 

0.04185 

-0.38596       -0.70335 

CLT 

0.3578C 

0.04557 

HTA 

0.  35503 

0.03840 

0.0625 

0.  44607 
(.00062) 

0.04758 

-0.82744       -0.67426 

CLT 

0.44725 

0.05095 

HTA 

0.4437S 

0.04352 
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TABLE    XI 
Simulation  Results    for   two-type    model 

M    =    5,    N    =    5,     Xi  =    20,     X^  =    30,    U  ^    =    50,    1^^.=    100 

Tims  Mean  Std.Dev.      Skewness      Kurtosis 


0,0100 

CLT 
HTA 

0.0250 

CLT 
HTA 

0.C375 

CLT 

HTA 

0.0500 


0.0625 

CLT 
HTA 


0.07128         0.013a5 
(.  00013) 


0.07065 
0.  07  10  1 


0.  17663 
0.  17752 


0.  26495 
0,  266  2"/ 


0.  44158 
0.4437S 


0.02038 
0.01315 


0.17832        0.02632 
(.00031) 


0.03223 
0.02528 


0.26638         0.03525 
(.00045) 


0.03947 
0.03249 


0.35704         0.04139 
(.00053) 


CLT        0.35327        0.04558 
HTA         0.  35503         0.03840 


0.44385         0.04777 
(.00063) 


0.05096 
0.04352 


-0.79647      -0.76541 


-0.86195       -0.76107 


-0.87967      -0.76051 


-0.86977      -0.75428 


-0.82988       -0.72768 
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TABLE    XII 
Approx. Nornal  VS   Eapirical   quantiles 

M    =    5,    N   =    5,     Xi  =    30,    X^^  =    20,   |A^    =    100,     U^=    50 
Time.         Normal      .10      .25      .50      .75       .90      .95      .99 


0, 

0100 

CLT 

.  0*49 

.159 

.457 

.86  9 

.998 

1.0 

1.0 

HTA 

.  11U 

.229 

.442 

.713 

.919 

.979 

1  .0 

0. 

0250 

CLT 

.C78 

.194 

.462 

.809 

.  97  8 

.997 

1.0 

HTA 

.  113 

.228 

.442 

.717 

.916 

.973 

.999 

0. 

0375 

CLT 

.C68 

.204 

.455 

.787 

.962 

.995 

1.  0 

HTA 

.  Ill 

.224 

.432 

.702 

.909 

.965 

.999 

0, 

0500 

CLT 

.088 

.212 

.459 

.771 

.95  5 

.989 

1.0 

HTA 

.  Ill 

.226 

.434 

.696 

.898 

.  961 

.998 

0. 

0625 

CLT 

.CS3 

.212 

.465 

.773 

.94  5 

.986 

1.0 

HTA 

.  110 

.222 

.432 

.705 

.889 

.954 

.997 

M    =    5,    N    =    5,     X,  =    20,    X^=    30,     ^,   =    50,    Uj_  =    100 

Tine  Normal      .JO      .25      .50      .75      .90      .95      .99 

0.0100      CLT 

RTA 
0-0250      CLT 

HTA 
0.0375      CLT 

KTA 
0.0500      CLT 

HTA 
0.0625      CLT 

HTA  .115    .238    .451    .719    .898    .960    .997 


.041 

.137 

.433 

.83  3 

.998 

1.0 

1.0 

.  109 

.22  1 

.443 

.719 

.915 

.977 

1.0 

.062 

.170 

.425 

.765 

.969 

.997 

1.0 

.  103 

.223 

.438 

.708 

.911 

.975 

1.0 

.079 

.191 

.429 

.754 

.952 

.991 

1.0 

.  118 

.229 

.447 

.713 

.90  5 

.  969 

.999 

.075 

.18  1 

.417 

.724 

.939 

.986 

1.0 

.  106 

.222 

.431 

.693 

.897 

.965 

.998 

.081 

.198 

.436 

.745 

.93  2 

.980 

1.0 
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of  sk€wn€ss  for  these  particular  syst<;5ms  indicate  that  tha 
distributicn  of  the  empirical  response  time  is  a  little 
skewed  to  the  left,  and  the  measures  of  kurtosis  show 
thinner  tails  than  it  should  be  for  the  normal  dis'iribution 
even  for  a  moderately  large  work-time  requirement.  We  will, 
therefore,  observe  the  difference  between  the  normal  quan- 
tiles,  approximated  by  the  central  limit  theorem  and  by 
heavy  traffic  analysis,  and  the  empirical  response  tim^  to 
irake  fuither  judgement  on  the  appropriateness  of  the 
apprcximaticns. 

We  now  compare  the  empirical  response  time  at  each 
initial  system  state  to  the  various  quantilss  of  the  normal 
distributions  whose  mean  and  variance  are  approximated  by 
the  central  limit  theorem  and  the  heavy  traffic  analysis. 
Ihe  ccncept  of  the  computations  of  the  normal  guantiles  and 
the  relative  frequencies  of  the  empirical  response  time  is 
the  same  as  that  described  for  the  one-type  job  model  in 
chapter  IV.  The  results  shown  in  table  XII  indicate  almost 
the  same  behavior  in  distribution  of  the  empirical  response 
time  for  both  cases.  Again,  this  fact  indicates  that  the 
distribution  of  the  response  time  is  almost  independent  of 
the  job  type  of  the  tagged  job.  Those  values  indicate  that 
cur  r.cimal  approximations  agree  pretty  well  with  the  empir- 
ical response  times  obtained  by  simulation,  especially  when 
the  wcrk-time  requirement  becomes  large.  They  also  agree 
with  the  results  shown  in  tables  X  and  XI  where  the  measures 
of  skewness  show  a  slightly  left-skewed  distribution  and  the 
measures  of  kurtosis  (small  negative  values)  indicate  that 
the  distribution  of  the  empirical  response  times  has  a 
slightly  flatter  peak,  fatter  shoulders  and  thinner  tails 
than  the  normal  distribution.  Table  XII  also  shows  that  the 
empirical  response  time  has  a  slightly  higher  mean  than  that 
approximated  by  either  central  limit  theorem  or  heavy 
traffic      analysis.       However,        we      can      still   say      that      the 
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TABLE    XIII 
Simulation    results   for   a   two-type   model 


M    =    5,    N    =    5,     X,  =    UO,    X^  =    10,    U^   =    125,     U^  =    25 

Time  Mean  Std.Dev.      skewness      Kurtosis 


0.0100  0.072a6         0.01378 

(.  0001U) 


CLT 

0.07239 

0.  02491 

HTA 

0.07197 

0.01328 

0.0250 

0.  18158 
(.00035) 

0.02902 

CLT 

0.  18096 

0.03938 

HTA 

0.  17993 

0.02708 

0.0375 


CLT 

HTA 

C.0500 


CLT 
HTA 

0.0625 


CLT 
HTA 


0.27167         0,03886 
(.00051) 


0  .  27  1  a  4 
0.  26990 


0.  36193 
0.  35986 


0. 45241 
0. 44  98  3 


0.04823 
0.03590 


0.36227         0.04723 
(.00064) 


0.05569 
0.04326 


0.45220        0.05566 
(.00077) 


0.06227 
0.04964 


-0.74325      -0.76697 


-0.88632       -0.76209 


-0.92108       -0.74667 


-0.98223      -0.76223 


-0.94014       -0.74837 
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TABLE    XIV 
Results   for    a   two-type   model 


M    =    5,    N    =    5r     X,    =    10,     X^=    40,     U,   =    25,    U. 


=    125 


Time 
0.01CO 

CIT 
HTA 

0.0250 

CLT 
HTA 

0.0375 

CLT 
HTA 

C.0500 

CLT 
HTA 

0.0625 

CLT 
HTA 


Std.Dev.      Skewness      Kurtosis 


0  .  07  1 6  9 

(.ooom) 

0  .  07  1  7  C 
0.07197 


0.  17925 
0.  17993 

0  .  26  9  0  U 
(.000U9) 

0.  26886 
0.  26990 


0.  35851 
0.35986 

0.aa810 
(.00074) 

0 .  uu  8 1  a 

0, 44983 


0.0  1335 

0.02369 
0.0  1328 


0.17877         0.02802 
(.00035) 


0.03746 
0.02708 

0.03755 

0.04587 
0.03590 


0.35883        0.04561 
(.00062) 


0.05297 
0.04326 

0.05272 


0.05922 
0.04964 


-0.81156       -0.75757 


-0.85737      -0.81866 


-0.92639      -0.82570 


-1.00062      -0.79135 


-0.93762      -0.76072 
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TABLE    XV 
Approx.    Ncraal   7S   Eapirical    quantiles 


M    =    5,    N   =    5,     X,    =    'iO,     X^  =    10,     U^    =    125,     U^  =    25 

Tinie  Normal 


0.0100 
0.0250 
0.0375 
0.0500 
0.0625 


CLT 
HTA 
CLT 
HTA 
CLT 
HTA 
CLT 
HTA 
CLT 
HTA 


•  J  u 

•  —^ 

.  ^^ 

•  » -( 

.  _^^ 

.  __£^ 

.  ^^ 

.02a 

.116 

.445 

.907 

1.0 

1.0 

1.0 

.  110 

.22  8 

.433 

.710 

.905 

.973 

1  .0 

.  054 

.164 

.435 

.  820 

.993 

1.0 

1.0 

.  112 

.219 

.422 

.682 

.90  1 

.967 

1.0 

.070 

.186 

.428 

.795 

.981 

.999 

1.0 

.  113 

.224 

.414 

.693 

.899 

.  967 

.999 

.075 

.182 

.439 

.784 

.972 

.998 

1.0 

.  110 

.216 

.422 

.689 

.896 

.96  9 

1.0 

.083 

.20  0 

.443 

.765 

.95  9 

.997 

1.0 

.  118 

.222 

.427 

.683 

.891 

.958 

1.0 

M    =    5,    N    =    5,     X,   =    10,      A^=    40,     p^   =    25,     J-lj_  =    125 


Time 


Normal         .10      .25      .50      .75      .90      .95       .99 


0. 

.0100 

CLT 
HTA 

0. 

.C250 

CLT 
ETA 

0, 

.C375 

CLT 
KTA 

0 

.0500 

CLT 
KTA 

0. 

.0625 

CLT 
HTA 

027 

.119 

.447 

.906 

1.0 

1.0 

1.0 

110 

.230 

.458 

.737 

.93  1 

.982 

1.0 

061 

.178 

.451 

.  824 

.  99  1 

.999 

1.0 

121 

.236 

.464 

.734 

.93  0 

.985 

1.0 

068 

.191 

.441 

.790 

.97  9 

.999 

1.0 

117 

.239 

.451 

.725 

.  927 

.983 

1.0 

081 

.189 

.430 

.776 

.975 

.997 

1.0 

117 

.232 

.444 

.729 

.935 

.985 

1.0 

085 

.199 

.442 

.772 

.960 

.995 

1.0 

121 

.237 

.456 

.737 

.923 

.97  9 

1.0 
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distribution  of  the  empirical  response  time  in  table  XII  is 
not  far  from  being  normal  especially  when  the  work  reguire- 
men-  is  large.  The  heavy  traffic  analysis  gives  a  better 
apprcximaticn  for  small  amount  of  work  rsguirement,  while 
for  large  work  requirement  the  central  limit  theorem  shows  a 
slightly  better  approximation. 

More  results  are  shown  in  tables  XIII  and  XIV  for 
the  case  of  Xj  =  40,  X2.  ="  ''0'  Pi  =  ''25,  ^2.  ~  ^5  and  the  case 
of  reverse  rates  respectively.  The  values  in  both  tables  do 
not  differ  much.  This  again  indicates  that  the  distribution 
cf  the  response  time  is  independent  of  the  job  type  of  the 
initial  tagged  job.  The  comparison  of  the  empirical  response 
time  to  the  quantiles  approximated  by  the  central  limit 
theorem  and  the  limiting  diffusion  in  heavy  traffic  shown  in 
table  XV  also  suggests  the  same  conclusion.  Finally,  tables 
XVI  and  XVII  show  the  results  for  a  single  job  type  model 
with  the  arrival  and  service  rates  from  the  average  rates  of 
the  two  job  type  model,  i.e.  N  =  10,  X  =  25,  |J  =  75.  The 
values  in  those  tables  suggest  that  there  might  te  seme 
particular  cases  where  we  can  use  the  single  job  type  model 
to  approximate  the  two  job  type  model.  However,  further 
investigation  is  not  included  in  this  thesis. 
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TABLE    XVI 
Simulation  results   for   one-type    model 

N=10,     X=25,    U=75 

Time  II ©sn  Std  .Dgv.      Skewness      Kar-^osis 

0.0100  0.07008  0.01391         -0.7089U       0.70894 

(.  00024) 

CLT  0.07008  0.02058 

ETA    II         0. 07000  0.0  13U5 

0.0250  0,17656  0.02629         -0.94906       1.66179 

(.00053) 

CLT  0.17520  0.03253 

ETA    II         0.  17500  0.02576 

0.0375  0.26202  0.03607        -0.85598       1.32022 

(.00076) 

CLT  0.2628C  0.03984 

ETA    II        0.26250  0.  03302 

0.0500  0.35014  0.04299        -0.76443       1.08030 

(.00094) 

CLT  0.35041  0.04601 

ETA    II         0.  35000  0.03897 

0.0625  0.43879  0.04783         -0.81254       1.31538 

(.00106) 

CLT  0.43801  0.05144 

ETA    II         0.43750  0.04412 
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TABLE    XVII     • 
Quantile    ccmparison   for   one- job    model 

N    =    10,      X    =    25,     Li    =    75 

Time           Normal         .JO      -25      .50      .75  .90  .95  .99 

0.010C      CLT               .CUa    .157    .445    .84  9  .997  1.0  1.0 

HTA    I         .C60    .176    .443    .814  .988  1.0  l.o 

HTA    II       .117    .235    .443    .722  .912  .976  l.o 

0.0250      CLT               .067    .161    .424    .789  .972  .999  1.0 

HTA    I         .080    .132    .418    .754  .94  6  .991  1.0 

FTA    II       .093    .204    .418    .712  .912  .973  1.0 

0.0375      CLT               .Ce9    .203    .464    .764  .957  .994  1.0 

HTA    I         .103    .221    .460    .74  0  .934  .984  .9  99 

HTA    II       .114    .235    .460    .719  .907  .970  .999 

0.0500      CLT               .092    .214    .447    .763  .947  .985  .999 

HTA    I         .106    .234    .445    .734  .916  .968  .998 

KTA    II      .116    .243    .445    .715  .901  .959  .997 

0.0625      CLT               .C83    .209    .440    .756  .94  0  .985  .999 

HTA    I          .102    .223    .437    .717  .914  .975  .999 

HTA    II       .111    .233    .437    .707  .899  .963  .998 
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VI.  SUMMARY  AND  CONCLOSION 

1,   SOMMaBY 

W€  brought  up  a  concept  of  proc9ssor-sharing  and  then 
described  a  model  for  processor-shared  work-time  allocation 
cf  a  computer  system  with  one  type  of  terminals  as  a  tirth- 
death  process  under  Markov  assumptions  in  the  first  chapter. 
In  the  second  chapter,  the  mean  response  time  of  a  tagged 
job  that  reguires  a  fixed  amount  of  processing  time  was 
derived  fcas€d  on  a  condition  that  the  tagged  job  enters  to 
find  an  initial  number  of  jobs  present  for  processing.  We 
also  derived  some  higher  moments  of  the  response  time  by 
means  cf  differential  sguations  which  led  to  the 
computations  of  variance,  skewness  and  kurtosis  of  the 
distribution.  Some  numerical  results  obtained  by  solving 
those  differential  equations  were  then  given  as  an  example 
for  a  system  with  two  terminals  and  the  arrival  and 
departcre    rates    are    1   and   2    respectively. 

A  simulation  procedure  for  the  response  time,  given  an 
initial  system  state  when  the  job  was  tagged  to  the  system, 
was  described  in  Chapter  III.  We  detailed  an  algorithm  for  a 
particular  two-terminal  system  to  check  with  the  numerical 
method  and  generalized  it  for  a  computer  system  with  a  fixed 
number  of  terminals.  Eased  on  those  empirical  response  times 
we  shewed  how  to  compute  the  mean  response  time  using  the 
steady-state  distribution.  The  standard  errors  of  the  mean 
response  tine,  the  empirical  moments  and  the  measures  of 
skewness  and  kurtosis  of  the  response  time  were  also  derived 
in  that  chapter.  In  Chapter  IV,  we  derived  the  formulas  to 
compute  the  approximate  normal  mean  and  variance  of  the 
response     time    by      the   central      limit      theorem   for      additive 
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functior.als  of  a  tirth-death  process  and  also  by  th^ 
limiting  diffusion  approximation  in  heavy  traffic  situation. 
Eased  en  those  approximated  means  and  variances,  w<? 
explained  hew  to  compute  the  various  quantiles  and  compared 
them  to  the  empirical  response  times  obtained  by  simulation. 
The  difference  between  the  relative  frequ9nciss  of  the 
empirical  data  and  the  CDF  of  the  approximated  ncrinal 
distributions  indicates  how  well  the  normal  distributions 
agree    vith    thr    empirical  response   times. 

In  Chapter  V,  we  described  a  model  for  a  computer  system 
with  two  types  of  terminals,  again  under  Markov  assumptions 
for  a  tivariate  birth  and  death  process.  Only  now  we  have  to 
consider  a  condition  that  the  tagged  job  is  one  of  the  two 
types.  The  steady-state  distribution  was  then  derived  for 
this  two-type  system.  This  allows  us  to  remove  the  condition 
of  initial  system  state  and  leads  to  the  computations  of  the 
uean  response  time  of  a  tagged  job  that  requires  a  fixed 
amount  of  processing  time  as  for  one-type  model.  The  ccmpu- 
taticns  cf  higher  moments,  thus  the  measures  of  skewness  and 
kurtosis,  were  also  explained  as  well  as  the  standard  error 
cf  the  mean.  Two  approximations  for  a  normal  distribution, 
one  tassd  on  the  central  limit  theorem  fcr  additive  func- 
tionals  and  the  ether  one  based  on  the  limiting  diffusion  in 
heavy  traffic  situation,  were  derived  for  this  two-type 
model  in  the  same  way  as  for  the  ona-type  model. Next,  a 
procedure  to  simulate  the  response  time  of  a  tagged  job 
given  an  initial  system  state  was  described,  and  then  based 
en  these  empirical  data  we  make  comparison  to  the  quantiles 
of  the  approximating  normal  distributions  to  study  the 
behavior  of   the    empirical  response   times   towards    normality. 

Finally,  for  appendixes,  we  attached  two  programs 
writter  in  FORTRAN  to  perform  the  simulation  of  the  response 
times  as  described  in  Chapters  III  and  V  respectively. The 
program      in   appendix    A     simulates      the      response    time      of      a 
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tagged  job  tasad  on  its  work-time  requirament,  th^  siz9  of 
the  system  and  the  arrival  and  departure  rates  for  a  singla 
job  type  model.  It  computes  tha  statistic  alaments  of  the 
empirical  response  times  such  as  mean,  variance,  skewness 
and  kurtcsis.  It  alsc  computes  the  guantiles  of  the  ncrmal 
distributions  whose  mean  and  variance  are  approximated  by 
the  central  limit  theorem  and  heavy  traffic  analysis.  It 
then  computes  the  relative  frequencies  of  the  empirical 
response  times  compared  to  the  quantilss.  Tha  standard  error 
of  each  relative  frequency  is  also  computed.  This  will  help 
us  to  make  a  judgement  on  the  number  of  replications  needed 
for  simulation.  The  program  in  appendix  B  provides  the  same 
things  fcr  a  two-type  job  model.  Wa  only  have  to  input  the 
mean  and  variance  for  the  approximation  by  the  central  limit 
theorem  from  an  APL  program  due  to  a  large  number  of  matrix 
operations. 

E.       CCNCIOSION 

The  agreement  of  the  normal  approximations  with  the 
simulaticn  is  satisfactory  for  both  one-type  and  two-type 
models,  especially  in  the  cases  of  large  wcrk-time  require- 
ment and/or  under  heavy  traffic  situations.  The  central 
limit  theorem  apprcximaticn  always  works  when  the  work 
requirement  is  large  enough  even  if  we  don't  have  a  heavy 
traffic  situation.  The  approximation  based  on  the  heavy 
traffic  analysis  seems,  however,  to  work  better,  given  that 
the  system  is  under  a  heavy  traffic  situation,  than  the 
central  limit  theorem  approach  for  small  work  requirement. 
Eut  in  a  light  traffic  situation,  the  limiting  diffusion 
apprcximaticn  does   not   work    well    at   all. 

Based  on  the  values  of  skewness  and  kurtosis  of  the 
empirical  response  time,  we  have  tried  to  use  the  Edgeworth 
expansion   tc  improve   the  normal   distribution   of   the   response 
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time  approximated  by  the  central  limit  theorem.  Th^ 
distritutior.  computed  by  the  Edgsworth  approximation  is 
close  to  the  CLT  normal  distribution,  and  the  results  dc  not 
indicate  significant    improvement. 

In  the  two-type  mcdel,  we  observe  that  the  response  time 
distributicn  appears  to  be  almcst  independent  of  the  type  of 
the  tagged  job.  It  is  hard  to  make  a  judgement  on  the 
behavior  of  the  empirical  response  time  based  on  the  obser- 
vaticns  cf  the  mean,  variance,  skewness  and  kurtosis,  even 
though  those  values  indicate  that  the  distribution  is  well 
approximated  by  the  normal.  The  simulation  for  the  response 
time  cf  the  two-type  model  involves  a  lot  of  computations. 
For  exairple,  in  a  system  consisting  of  5  type  I  and  5 
type  II  terminals,  we  have  tc  consider  30  initial  system 
states  in  total.  If  w€  want  to  perform  a  simulation  with  500 
replications,  it  will  involve  at  least  15,000  computations. 
This  fact  indicates  that  the  round-off  error  may  be  substan- 
tial. Hcwever,  the  relative  frequencies  of  the  empirical 
response  time  comparing  to  the  approximate  normal  quantiles 
obtained  for  the  particular  cases  in  this  thesis  are  in  a 
rather  gcod  agreement  with  the  theoretical  suggestion.  This 
means  that,  under  the  Markov  assumptions,  the  distribution 
of  the  response  time  of  a  tagged  job  that  requires  a  fixed 
(large)    amount    of   processing   time   is   approximately   normal. 

Thrcughcut  this  thesis  we  have  been  assuming  that  the 
distributions  of  the  arrival  and  service  times  are  exponen- 
tial. However,  all  the  computations  done  for  both  models  can 
as  well  te  extended  to  the  case  of  general  distribution  of 
service  time.  It  might  be  of  interest  to  study  the  models 
and  derive  a  method  tc  simulate  the  response  -ime,  since  in 
the  real  world  we  would  always  have  to  deal  with  a  more  and 
more  sophisticated  computer  system  which  is  capable  of 
dealing  with  many  kinds  of  work.  So  further  study  might  be 
needed    for   such    system. 
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